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This report presents the results of a year-long pre- and postinstitute evaluation 
of the 6-week summer workshop for 221 primary grade teachers of disadvantaged 
children from 41 different New York City schools. The report is organized around the 
findings obtained from each of nine evaluation instruments and checklists used to 
measure (1) changes in science knowledge and information (in biological, earth, and 
physical science areas), (2) changes in attitudes toward science and science teaching, 
(3) changes in teacher behavior in the classroom, (4) changes in the schools and in 
the pupils, and (5) over-all effectiveness and suggested modifications of the 
Institute. Descriptive analysis of the data is given. Included is discussion of the 
background, characteristics, and selection of the teacher-participants and of the 15 
s^^Tvisor-participants who were elementary school coordinators trained in 
additional teacher education and supervisory techniques as members of the 
instructional team of the workshop. Major findings are summarized in terms of the five 
areas of interest noted above, and conclusions are presented regarding the 
(imitations of the Institute, the evaluation, and suggested modifications and 
improvements. All except one of the nine instruments, eight of which were developed 
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During the academic^y^:^SBfd^^;^ummer of 1966, an ^EA Institute for Advanced 
Study was conducted at Hunter College. The Institute was unusual for several 
i*easons; It was very large with a total of 2h0 participants; it was focused on 
the needs of teachers and supervisors from disadvantaged urban areas; it used 
as its subject matter the area of elementary school science; it concentrated on 
inproving the instructional capabilities of primary grade teachers. In short, 
it was an inovative program in many ways. 

As might be expected, all of the responsible personnel involved in mounting 
and implementing the program had clear hopes but also many concerns about the 
efficacy of such an undertaking. Would the program reach all, or even most, of 
the teachers? Would it help them overcome some of their fears of science and of 
teaching the subject matter? Would the program succeed in changing teacher 
behavior? Would teachers return to their classrooms and allow children to "dis- 
cover” science information rather than continue, as they had previously dene, 
to "preach” science information to their children? And, most important of all, 
if all of these changes did take place in the teachers, would it make any dif- 
ference in the children? 

Of course, a considerable amount of time and money was allocated for the 
pj»Qj 00 't, The NDEA funds alone amounted to almost a quarter of a million dollars. 
Beyond that. City University funds were allocated in the form of staff time, 
facilities, and general expenses. Then there were the time and efforts of New 
York City Board of Education personnel. The expenditure of such a large sum 
would have justified careful evaluation of the project. However, much more was 
at stake than even the expenditure of $ 3 ^ 0 , 000 . 

If the plan succeeded, or even showed promise of success with modifications 
based on its analysis, the pattern used during the first year might provide a 
model for other elementary school institutes in other places and in other sub- 
ject matter fields. 

In the light of this situation, the USOE and the City University of New York 
made funds available for a special study of the effectiveness of the program. 

The resulting study is reported in the attached document. 

As Director of the Institute, it is my privilege to transmit the findings 
of the study to all concerned. At this sAme time I wish to acknowledge the 
helpful work of the evaluation team who carried out the study and particularly 
to commend Mrs. Barbara Heller who authored the report and led the evaluation 
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Director 
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INTRODUCTION 



Problem 



During the past decade ^ as it became increasingly apparent that 
training in science was the key to the continuance of scientific and 
technological progress, science instruction received a great deal of 
attention. Interest in the teaching of science has increased and 
there is a growing trend for people from different disciplines to 
begin to examine the manner in which the subject is being taught: 
Textbook materials are rewritten! curricula are adapted; supple- 
mentary teaching and learning aides are available; new materials, 
ideas and techniques are developed. In addition, methodology and 
content courses are being added to the pre-service teacher educa- 
tion curriculum, and there is a growing enq)hasis on in-service 
education in sci( nee for the more than one million elementary 
school teachers in the country. 

Concurrent with the eir^hasis on science instruction is the grow- 
ing awareness of the needs of disadvantaged children and the promise 
that this new science, with its concern for individualized activr’ties 
and process -centered orientation, may be very successful in meeting 
the specific needs of these children. The science that children from 
disadvantaged environments muit learn however, is really no differ- 
ent from the science all children should master; all teachers should 
become familiar with the techniques, materials and ideas appropriate 
for a process -centered elementary school science program. 

The problem is to provide such individualized in-service edu- 
cation for the vast number of teachers in disadvantaged area schools. 
The proposal for the NDEA Institute in Elementary School Science 
proposes a solution to the problem of educating a large number of 
people in the new materials and ideas available which stress the 
activity approach to science. 



The NDEA Thotitute in Elementary.. School Science * • ^ 

In the Summer of 1966 the U. S. Office of Education, under Title 
XI of the National Defense Education Act, provided funds to conduct a 
workshop in science designed especially for and limited to 22^ teachers 
in the primary grades (K-ii) from disadvantaged area schools. The work- 
shop lasted six weeks, from July 5 to August 11, 1966. The basic assum- 
ptions of the Institute workshop were that: 

"A group of teachers, though iminformed in science, can learn a 
limited but valuable selection of science concepts and master techniques 
for developing activity and process-centered programs built around these 
concepts through a workshop program, and 

"The over-all size of the workshop need not affect adversely the 
quality of an individual participants' experiences provided each partic- 
ipant is a member of a well-organized and well -led sub-group, and 

"Teachers of the primary grades of dd.sadvantaged area schools have 
many common problems, including the problem of weak science backgrounds." 
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The conseqaences resulting from these assumptions delimit the 
Institute: 

1. The workshop was to be limited to 22^ primary grade teachers 
of disadvsintaged children 

2. The workshop was to be devoted to a study of carefully selected 
concepts from three science areas, plus the materials and techniques 
needed for process -centered activity programs 

3. Fifteen elementary school science coordinators were to be select- 
ed as members of the instructional team of the workshop 

» * 

U. These coordinators were to be taught additional teacher educa- 
tion and supervisory techniques. 

Although the complete statement of objectives for teacher-partici- 
pants can be found in Appendix A., the most salient ones are summarized 
below. Teacher-participants are expected to; 
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Gain knowledge of ^ . n 

a. selected basic concepts in the biological, 



physical and 



earth sciences 

b. the available materials and techniques for teaching these 
concepts to children 



2. Learn techniques for 

a. exploring other science concepts and generalizations 

b. using curricular materials to teach processes and gener- 
alizations to their classes 

c. developing teaching styles appropriate for guiding inquiry 
in the classroom 



3. Master skills in the use of 

a. laboratory materials 

b. educational materials and methods for teaching science 



EVALUATION OF THE NDEA INSTITUTE IN EI£MENTARY SCH OOL SCIENCE 

The original research plans proposed a year long evaluation 
teacher-participants to start during the Spring semester "to 

Summer of 1966 and to continue through the following year. The original 
proposal called for the "evaluation of the project including an examin- 
ation of the changes in attitudes, knowledge and skills of the teacher- 
participant group as determined through paper and pencp J’^d/or inter- 
^dew devices used with the total group and of changes in teaching 
iors and practices as determined by classroom observations of a selected 

sanple of teachers." 

The primary objective of the evaluation, as it developed, was 
assess the effectiveness of the Institute, to determine how successful 
the Institute was in meeting its own goals. The consequences for the 
evaluation effort were to determine (l) whether teacher-participants 
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were ’’unlniformed in science” and had negative attitudes toward science, 
and (2) whether teachers were deficient in mastery of techniques, skills 
and materials for developing activity, process -centered programs, and 
to see if the workshop experience corrected and alleviated the pre-ex- 
isting patterns. 

The design was essentially a pre- and post- Institute contrast of 
specific behaviors selected for study. Each participant would be compared 
with himself; the pre-institute results would provide the baseline 
against which any change would be measured. 

The evaluation was directed toward five areas of interest; (l) 
changes in scientific knowledge and information, (2) changes in attitudes 
toward science and teaching science, (3) changes in behavior related to 
teaching science in the classroom, (ii) change in the school and in rat ■ 
ings of pupils, and (5) over-all effectiveness of the Institute. 

Instillments Used in the Evaluation 



A copy of each of the measures used in the evaluation can be found 
in Appendices B through J. The battery of nine measures included; 

Teacher-Participant School Checklist (Appendix B) 
Supervisor-Participant School Checklist (Appendix C) 

Test of Science Concepts (Appendix D) 

Elementary Science Survey (Appendix E) 

A "Measuring Meaning" Test (Appendix F) 

Teacher-Participant Evaluation of Effectiveness (Appendix G) 
Supervisor-Participant Evaluation ofl Ewectiveness (Appendix H) 
Supervisor -Participant Observation Form (Appendix l) 

Evalua.tors’ Observation Schedule (Appendix J) 

With the exception of the Elementary Science Survey, all instru- 
ments and checklists were developed by the evaluation team. A brief 
description of each of the measures and procedures used follows below; 



Teacher-Participant School ‘Checklist ; 

This was a self-rating scale administered to teacher-participants 
before and after the Institute, in April 1966 and again in March 1967. 
Each of the participants received a copy of the Checklist with instru- 
ctions, and a return envelope. Since each respondent mailed her com- 
pleted Checklist directly to the evaluators, a high degree of confid- 
entiality was assured. In general, response to this measure was high 
and positive. 

The Checkli sb was designed to elicit information about the teach- 
ers* general background, attitudes, abilities and interests toward 
teaching science as well as information about the schools' science 
programs and the pupils' interest in science. The Checklist contained 
sections on "Science in the School," "Science in the Classroom," a 
"Science Self-Rating Scale" and, "Science and the NDEA Institute*” 
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Supervisor-Participant School ’Checlclist : 

This was a two-page questionnaire to be completed by the Supervisors 
in April 1966 and again in March 196? • Each supervisor was responsible 
for obtaining information about each school represented in his group. 

(See Table 1 fo'r .the number of different schools represented in each of 
the supervisory groups.) 

It contained detailed questions about science instruction, equip- 
ment, supplies, and distribution of (science) responsibility in the 
schools. Information was sought about ordering books, supplies and 
equipment, amount of time devoted to science instruction, special science 
programs and facilities, etc. It was anticipated that this type of back- 
ground knowledge would be of aid In determining any effects of the NDEA 
experience on the school itself. 



Test of Science Concepts ; 

This test, developed specifically to measure scientific reasoning 
and science education information, was administered to all teacher-par- 
ticipants, It was part of a battery of tests given on July 5?, the first 
day of the summer Institute and again on August 11, the last day of the 
Institute. 

The test consists of six reading passages on different science sub- 
jects followed by seven multiple-choice questions for each passage. The 
first three of the passages were topics coxrered during the six-week 
period: motion and chosen frames of reference 5 tenperature and change 

of phase; and living things responses to stimulae in their environments. 
The remaining three passages - classification of organisms, force and 
acceleration, energy changes in chemical systems - were not to be sub- 
ject to direct instruction in the Institute classroom. 



Elementary Science Survey : 

teis diagnostic instrument, constructed by Teachers College, 

Columbia University, was part of the battery administered to the teacher- 
participants at the beginning and end of the Institute. This is an 
eighty-four item multiple-choice test designed to diagnose deficiencies 
in science background. It contains items and areas covered in the course 
of the Institute as i?ell as items and areas not directly covered; for 
our purposes the Elementary Science Survey provides a measurement of 
amount and kind of information and knowledge about science. 



Measuring Meaning : 

Included in the test battery administered at the beginning and end 
of the Institute was an adaptation of the Osgood "Seioantic Differential", 
or Measuring Meaning Test . The semantic differential schema purports to 
measure changes in points of view along certain specified dimensions; 
our adaptation consisted of an evaluative and an under standability dimen- 
sion. 
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The concepts to be measured included; Process-Centered Activities, 
Individualized Science Activities, Disadvantaged Children, !^y Teaching 
Skills and Techniques, Science Instruments and Materials, Jfyself as a 
Science Teacher, Scientific Investigations by Pupils, Ify Elementary 
School, "Difficult” Students, and Scientific Knowledge, 



Teacher-Participant Evaluatibh^bf the'^ffectiveness of" the Institute ; 

The first section of this two-part opinionnaire consisted of 
statements derived from the Institute’s listed objectives. Each state- 
ment was rated on a U-point scale ranging from, the "Institute has had 
an OUTSTANDING POSITIVE EFFECT ON, "to, the "Institute has had a NEGATIVE 
EFFECT ON." In the second section the participants were asked to list 
the specific areas in which they received and did not receive help in 
and, suggestions for improving the Institute. 

This opinionnaire was administered at the end of the Institute to 
all teacher-participants as part of the battery of tests. 



Supervisor -Participant Evaluation of the Effectiveness of the Institute ; 

The fifteen group supervisors were asked to complete a two-part 
opinionnaire similar to the one described above for the teacher-parti- 
cipants. !Di this edition, supervisors were directed to evaluate the 
effectiveness of the Institute on the members of their group. 



Behavior Observation Schedule; 

This was a classroom obse3:*vation schedule developed to assist in 
the determination of changes in science teaching skills and techniques. 
Its primary purpose was to yield information about similarities and 
differences in the classroom behavior of teachers before and after the 
summer Institute, 

Specific behaviors, related both to the Institute’s immediate 
objectives and the objectives of good science teaching, were noted - 
what the teacher did, as well as how well and how often she did it. 
Some of the specific behaviors included the diversity and quality of 
materials used by the teacher in various stages diiring the lesson, 
errors in scientific terminology and explanations, individualized 
activities, etc. General behaviors included adequacy of preparation, 
poise, over-all quality of the lesson, etc. 

Observations were to be conducted in 39 classrooms of a subsample 
of selected teachers. For a conplete description of the sampling, see 
the section on Classroom Observations. The teachers were to be seen 
by the evaluation team in April 1966 (pre-institute), October 1966 
(post-institute) and again in April 1967* 
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ObaGrYation SchGduXG for SupGrvisorss 

A simplified and more ~ s trucWa.r ^sion of the SchedTg^ described 
above was adapted for use by the supervisors to observe the teachers 
in their groups in the classroom before and after the xnstitate. 
pre-institute observations occurred in April-Jw.e 1966; the post-insti- 
tute observations took place in March-April 196?^ Retens on this 
Schedule were not complete and will not be considered in the report on 

the results of the study. 



Selection of the Participants for the NDEA Institute 

The original proposal specified acceptance of 22^ teachers as par- 
ticipants in the Summer Institute; early in the Spring of i 960 
the supervisors previously chosen by the Directors made recommenda- 
tions of candidates. A total of about 280 applications from teachers 
were received. Careful review of the applications by the Directors 
resulted in elimination of some, and final selection, by the end of the 
Spring semester, of 22^ teacher participants. A complete description 
of the qualifications for both supervisor and teacher-participants can 
be found in the original proposal. 

The Institute began on July ^ with 22^ teachers and supervisors; 
by the end of the six week period a total of 221 teacher -participants 

remained. Four persons dropped out of the * 

All findings will be based on data from the 221 teacher-participants 
who completed the entire planned sequence of summer activities. 



Description of the Fifteen Supervisors and Supervisory Groups^ 

There were 1^ groups generally working as separate units during 
the Institute. For a complete description of the si^er sequence of 
activities and events, see the appropriate section in the original 
proposal. Each group was headed by a supervisor who was responsible 
for coordinating the activities of his group, for preparation and 
follow-up of total Institute events, ^d other specific and general 
supervisory and instructional responsibilities. 



Thirteen of the supervisors were male, two were female. There 
were seven supervisors who were Assistants -to -Principals, five district 
science coordinators and three teachers who served as group supervisors . 
The Assistant Principals had supervisory authority and experience over 
the teachers with whom they worked, but were relatively untrained in 
science; the district coordinators had more science background but no 
official supervisory authority. The teachers of course, 
leaders of their groups. Two teacher supervisors were from disadvant- 
aged communities outside New York City; the particip^ts in 'tbeir 
groups taught in schools outside the City system. The rest of the 
Lpervisors, and the teacher-participants in their groups, were all 
employees of the New York City Board of Education. 
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Background Data Describing the Fifteen Supervisory Groups 



H 



ft, 



Oi 

<n 



p 






~=t 

rH 



& 



P 









CM 






o 

H 



S 



CO 

o 

CQ 
A 

I 

o o 









o 



s 



s 












Ee< 



a 



Si 



o 

o 

p 



cu 

••a: 



Si 



PU 

< 



o 

p 



o 

o 



o 

o 

o 



s 

o 

o 








H 


CM 

fH 


p 


H 


16 


Green 

burgh 


VO 


H 


NYG 


H 


H 


NYC 


CM 


>5 


Long 

Beach 






NYC 


rn 


VO 

H 


NYC 


CM 




NYC 


lA 


H 


NYC 


VO 


r»- 

H 


NYC 


\A 


10 


NYC 






§ 


H 


o\ 

H 



•z. 



I 

o 

ra 

o 



h 

o 

CO 






Q 

s g- 

P CQ 



O h 

_ o 

C CO 

o 

•H 
-p 
•H Q 

S & 

jP 3 

Oh (Q 



.hI 

o oa 
C ra 

5 H 

158 

38 



CQ 

•Sg* 

32 

€ So 

” c 

S3S 



8 

SS 60 



•• 

I 

n 



3 

8 

<D 



It II 
6 -» -a; 



o 

ERIC 



i 



Assistant Principal 



F 



1 



. 8 - 

In five of the fifteen groups all of the participants were in the 
same one school during the year prior to the Institute. There were a 
total of I4I different schools, one of which ^vided its teachers among 
three groups. Two groups had teacher -participants from as many as six 
different schools. The median number of schools per group was three; 
the median number of participants per group was 1^, with a range from 
10 to 19 • Table 1 summarizes these descriptive data for the fifteen 
groups. (See Table 1, page 7). 



Description of the Teacher -Participants 

Table 2 presents the distribution of participants by sex, age and 
marital status. These data are based on information contained in the 
"Application for Admission" and "Application for Stipend" subiaitted by 
each participant before the start of the Institute. (See Ta^le 2, page 

9). 



More than three-quarters, 76 per cent, of the total number of par- 
ticipants are female; Group #03 was exclusively female; group # 07 had 
the greatest percentage of ma.le participants - almost 38 per cent of 
group #07 was male. 

Over thirty per cent of the total teacher group was 2h years old 
or younger at the beginning of the Institute; an additional 22 per cent 
were between the ages of 2^ and 29. Interestingly, 1^ per cent of the 
total group was years or older. Group differences in age are appar- 
ent: group #12 may be described as the youngest group with 75 P©^^ cent 

of the teachers 2h years of age or younger. Contrast this with group 
03 in which only ten per cent of the participants fall within that age 
category, and 60 per cent of the participants were It5 years or older* 



Approximately 56 per cent of all participants were married, 38 per 
cent of the total group was single and the remaining six per cent 
widowed, divorced or separated. There is a fairly high rank-order 
correlation, .57, between age and marital status; The youngest groups 
(greatest percentage below 29 years old) tend to have the largest per- 
centage of never-married participants. Additional information describ- 
ing the academic and professional backgrounds of the participants are 
summarized in Tables 3 (see page 10) and h (see page 12). 



Table 3 summarizes, by group and for the total combined., the per- 
centage of teacher -participants by degree held; by major; and by 
semester hours, graduate and undergraduate, of science and science ed- 
ucation courses. (Upon satisfactory conipletion of the Institute each 
participant received seven graduate credits from Himter College.) 

Prior to the Institute, 57 per cent of the total number of par- 
ticipants had taken courses in excess of the baccalaureate degree and 
about 13 per cent had con^^leted courses beyond the master’s level. 

Three participants did not have any degree. Differences exist between 
groups; for exairrole, almost one-quarter of the participants in groups 
# 02, Oi*, and 0$ ha.d credits beyond the master’s degree; none of the 
Ik participants in group #10 had yet received a master's, while in group 
#08 all of the participants had progressed beyond the baccalaureate. 
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Table 2 

Description of the Teacher-Participants-, in the Fifteen Supervisory Groups 

Percentages by Groups 
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Coirplete information on academic major was available and is also 
tabulated in Table 3. Included in the behavorial sciences category- 
are psychology, sociology and anthropology majors; his-boi*y, civics 
and economics are categorized under social studies. I^th the excep- 
tion of "special education" the remaining categories are self explan- 
atory. Under the special education classification are included majors 
in physical and health education as well as education for the handi- 
capped. The major tabulated was the major of the highest degree held; 
for 78 per cent of the total group it was the baccalaureate major, and 
for the 22 per cent with a master's degree that major subject area was 

used. 



More than half, 53 per cent, of the total group majored in educa- 
tion; all participants in group # 06 and only eight per cent of those 
in grou^ # 13. For the combined total, -the next most popular major was 
the behavorial sciences although again the differences between groups 
arre great; there -were no beha-vioral science majors in groups § 03, OU 
and of course, 06, while at least UO per cent of groups # 07, 12 and l5 
fell in this category. One-quarter of the teachers in group # 13 weic’e 
social science majors and almost 20 per cent, 18, of those in gror^ 

# 08 majored in art or music. Three participants majored in science 
or mathematics. 

Academic minors -will not be presen-ted in tabular form although 
completed information is available. There was one mathematics minor, 
one ndnored in biology, one in physiology and four minors in science 
of the total of 221 participants. 

The number of semester hours, graduate and undergraduate, in 
science or science education courses is tabula-ted separately for each 
of the l5 groups and for the combined total. The percentage of par- 
ticipants having comple-ted 0-U# 5-9> 10-lU> 20-2U and 25 or more 
semester hours is recorded in Table 3* Thirty-seven per cent of the 
total groups combined completed 10-llj. semester hours prior -to the 
Institute, about 33 per cent completed between 5 and 9 hours, and 15 
per cent completed 15-19 semester hours in science or science educa- 
tion. More than 18 per cent of group # 08 had more than 25 hours, 
and all teacher-participants in group # 06 had at least 10-lU semes-ter 
hours without crediting for the Institute hours. 

Forty-six per cent of the total of 221 participants had, includ- 
ing -the semester before the start of the Summer Institute, three years 
or less of teaching experience. Ano-ther 26 per cent had between h and 
6 years experience; about 28 per cent had more than seven years -teach- 
ing experience and three per cent of these had taught for 21 or more 
years. These figures are summarized in Table ii. The indi-vidual dif- 
ferences between groups is notable: in group # l5 no participant had 
more than between 7 and 10 years experience; in gro\^ § 12 while more 
■than 80 per cent had -taught from one to three years, the remainder of 
the teachers each had more than 21 years of teaching experience. 

Although the oilginal proposal was restricted to teachers In grades 
K-U it was not possible to select qualified applicants solely from 
these grades. As can be seen in Table i(, approximately 6U per cent of 
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the total number of participants were K-l; teachers during the year 
1965-66. Another approximately 23 per cent of the total group taught 
grades 5 6 , about four per cent of the participants taught special 

classes (CRMD, Citizenship classes) and another four per cent were 
special teachers of reading, drama, art and other subject areas. Wiere 
were seven OTP (Other Teacher Personnel) in science and three cluster 
teachers. The percentage of participants by grade or class categoj^ is 
presented separately for each of the groups. (See Table k» page 12), 

In summary, the average teacher in the 1966 NDEA Institute parti- 
cipated in a group of l 5 persons, con^josed of persons from three dif- 
ferent schools in New York City and headed by a male Assistant Mnci- 
pal. She is most likely to be female, never married and below the age 
of 29. She has some graduate credits beyond the baccalaureate degree, 
a probable major in education and by the start of the Institute was 
likely to have conpleted between 5 and Ih semester hours in science 
and science education. During the semester prior the Institute it is 
probable that she taught in grades I-U5 she has had between one and 
three years experience in teaching. 



Description of the Resxilts 

It was decided to treat all the findings obtained from each of 
the instruments and measures used in the evaluation as a separate section 
in the following chapter on Results. The rationale for including 
together the results of both the pre- and post-institute measles - 
rather than presenting all pre-Institute results then all post-institute 
results - was economy of space and ease of comparisons. 



The first section will descid.be the findings obtained from 
two administrations of the Teacher-Participant School Checkligt. The 
analyses of these data will provide some inrormauion aoout science in 
the schools from which the participants came, about the way the par- 
ticipants taught science, some indications about how they feel about 
teaching science, and science attitudes in general. It will also 
contain some discussion about participants' expectations in regard to 
the forthcoming NDEA Institute. The results obtained one year later, 
after the Institute, are also presented. Comparsions can be easily 
made for each of the items in the Checklist ; we will present 
mation on any changes in the school and in the participating teacher 
that the participant ascribes to her summer experience. 

As confirmation on what actually occurred in the school - both 
Institute-related and Institute -independent, we have some sketchy 
data obtained from two administrations of the Supervisor-Particlp^ 
School Checklist. It was our intention to use this data to indicate 
school-idLde effe^cts, if any, of the NDEA Institute. 



Immediately following we will present the results of the Clas ^ 
room Observations conducted by the evaluation team, ^is ^^7 
vide again somieTnforraation on how a selected group of particip^ts 
actually taught a demonstration lesson and, more ^ 

changes in their teachiftg of science as a result of the NDEA Institute. 



o 



We had hoped to be able to present the results of Classroom Observations 
by the Supervisors both before and after the Institute, but there was 
insufficient data to be able to do so. ^'hat data does exist is not 
comparable and, in addition, the conditions under which the Supervisors 
observed their participants was not standardized. 

An issue of great concern is changes in the amount and kind of 
science information the participants learned during the six-week work- 
shop period. The results of the Test of Science Concepts and the 
Elementary Science Survey will direct attention to this issue. 

We were also interested in teachers’ attitudes toward science; 
we felt very strongly that it was attitude that underlay the way they 
taught - or did not teach - science, as well as their willingness to 
learn about science. The Semantic Differentials or "Measuring Meaning 
Test" , summarizes the initial and post-institute attitudes of the 
teacHer-participants to (1) the techniques and processes stresses in 
the Institute and (2) to the pupils in the classrooms. 

The final section of results will present the participants’ 
ratings of the Effectiveness of the Institutes all participants and 
many of the Supervisors completed these evaluations. Suggestions 
and needed modifications, as seen by the participants themselves, 
will be explored. 

Treatment of Data 



With three exceptions, the Test of Science Concepts , the Elemen- 
tary Science Survey and part I of the Teacher-Participant Evalualion 
of the Efj^eciiveness of the Institute , all other data were hand-scored 
and tabulated. 

Content analyses were done: in all cases the unit of measurement 
was "scoreable response," That is, each statement made was analyzed 
into its consonant parts and each part was tallied separately. Thus, 
a comment such as, "I want to learn more science this summer so I can 
teach my pupils how to discover things by themselves", was tallied 
once under "to leam more science" and once under "discovery method 
for pupils," There were, as a result, more scoreable responses than 
statements. It is also in^ortant to keep in mind that there were 
more statements usually than there were respondents, i. e., each 
respondent could - and did - usually make more than one response to 
the open-ended items. 

All results were obtained and analyzed separately for each super- 
visory group; in most casas the results will be presented for each 
group separately. In those instances where it would require too much 
space only total groups’ combined results are presented; however, 
group data are also available. 

Due to other than research-design limitations all statistical 
analyses are descriptive. Shortage of time and money prevented more 
sophisticated comparisons - correlations between tests, etc. Again 
however, the data for such statistical treatments are available and 
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the data may be reanalyzed in the future. 

One additional word: The .0^ level of confidence was the minimum 

accepted for significance. Any comparison that did not meet the ,0$ 
level of confidence is considered not significant (NS) in the report. 
That is not to say however that :-ll tests meeting this criterion of 
statistical confidence actually have educational significance as well. 
Some of the statistically significant results, as will be discussed in 
the sximmary of the report, may be due to the design of the study, the 
size of the sample, or other factors, and thus may not have any rel- 
evance to behavior in the classroom, or more importantly, result in 
changes in pupil performance. 



RESULTS OF THE TEACHER-PARTICIPANTS* RATINGS; SELF, SCHOOL, STUDEITO 

The Teacher-Participation Checklist , administered in April 1966 
(pre -institute) and again in March 1967 (post-institute) yielded ad- 
ditional information about the participants* recent career history, 
future teaching plans and attitudes toward science teaching and the 
classroom. 

Two forms, I and H of the Checklist were used. Both forms were 
almost identicalj the major changes were in dates, e. g, , *’Do you 
expect to be in this school during 1966-1967"> or **1967-68?" and in 
questions about expectations, ]ji the first administration, for ex- 
ample, the participants were asked what they expected to learn and 
accomplish as a result of the Institute experience, xirhile for the 
post-administration the question was **T'Jhat did you learn and accom- 
plish...** A copy of the Checklist is found in Appendix B. 

i')hy include in an evaluation this type of open-ended instru- 
ment? There are several reasons: One is that it gives participants 

the best opportunity to express themselves in a situation where 
their comments and responses are not delineated by a *'forced-choice,*’ 
or pre -determined category. In retrospect we would not have been 
able to anticipate and provide for the variety of possible responses 
we obtained, nor would a more structxired techniqxie allox^ed fc-r the 
depth of the comments and the flavor of individual styles of I'esponse. 
Several suggestions may not have appeared or would not have ajpeared 
in the same form. 

Some of the questions asked did not prove useful, neither to the 
participants nor to the evaluation, and should therefc-re be deleted. 
There was also some difficulty in the wording of some questions: re- 
visions of the instrxament is necessary for greater c?uS!.* ity aud under- 
standability on the part of the respondents and less ajpbigulty in 
interpretation for the evaluation. In general however, the instrument 
has been most useful in both the new information it yielded and in 
the conf innation of results obtained elsewhere. 

As already noted this Checklist was individually sent to each 
of the 221 participants. Return envelopes were provided and the 
instructions to the teachers stresses confidentiality and anonymity 
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of responses. After one follow-i?) letter requesting completion and 
return of the, April 1966 C hecklist a total of 209 resx>onses were 
returned. Table 5 summarizes the number and percentage of responses, 
by groiQ3 and for the total population, to both administrations of 
the Teacher "Participation Checklist. 



Table $ 

Number and Percentage of Respondents to Both Administrations of The 

Teacher-Participant Checklist 

Checklist I (Pre) Checklist II (Post ) 

Group: Total N N Per Cent N Per Ceni 



01 


19 


16 


8U.2 


10 


52.6 


02 


15 


15 


100.0 


Ih 


93.3 


03 


10 


10 


100.0 
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90.0 


Oh 


17 


16 


9U.1 


13 


76.lt 


05 


17 


16 


9lt.l 


lU 


82.3 


06 


15 


12 


80.0 
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60.0 


07 


16 


16 


100.0 


13 


81.2 


08 


11 


11 


100.0 
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72.7 


09 


15 


15 


100.0 


11 


73.3 


10 


Ih 


Ih 


100.0 


10 


71. U 


11 


Ih 


Ih 


100.0 
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6U.2 


12 


16 


15 


93.8 


Ih 


87.5 


13 


12 


12 


100,0 
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50.0 


lU 


15 


15 


100.0 


10 


66.7 


15 


15 


15 


100.0 


10 


66.7 


T5?il 


551 


515 




156 


75nil 



Approximately 96 per cent of the total group responded the first 
time. In ten of the 15 groups response was con?>lete and no more than 
three persons in any group failed to respond. 

April 21 was closed as the cut-off date for response to the second 
administration of the Checklist . A total of l60 responses, about 72 per 
cent of the total group, were received sifter one follow-up request. The 
percentage of responses was not as great as the percentage responding 
the first time. For example, only half of group 13 responded to Check- 
list II, while 100 per cent responded the first time. However, as many 
as 93 P©r cent of group 02 responded to the second administration, and 
more than three-quarters of groups 03, OU, 0$, 07 ^ and 12 returned the 
post-institute form. 

Ninety-eight per cent of the total number of respondents to Check- 
list I, a total of 205 teachers, were in their school for the entire 
year 1965-66 preceding the Institute. Of the total 209 respondents, 
only six per cent (13 teachers) planned to be in a different school 
during the year after the Institute. Another eight per cent (17 per- 
sons) ^cpected to have different positions or expected to be teaching 
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at other grade levels (in the same school) for the year 1966-67. These 
figures are based on statements made In response to Checklist 1 , and 
are summarized in Table 6. Data based on responses to Checklist II 
(March 1967) provide a comparison of stated expectations concerning 
future teaching plans with actual teaching positions for the year. As 
can be seen in Table 6 (see page 18), l6 persons were in different 
ficiiools during the year immediately following the Institute, Included 
in these 16 however, are five on maternity leave not expectating to 
return. One of the 16 became a Principal, and another an Assistant 
Principal in new schools. 

More interesting however, is the fact that of the original 13 
people expecting to be in different schools, four remained in the 
same school, two did change schools, and the remaining seven did not 
respond to the questionnaire. In other words, Ik of the l6 persons 
in new schools did not expect to be there in April of 1966. Thus it 
is apparent that there were either last-minute decisions to change 
schools or, alternatively, some participants did not inform us of 
their future expectations. It is iupossible to determine how many 
of the 61 non-respondents also changed schools or assignments. 

There i^ere a total of 79 participants who held different 
positions and/or taught at different grade levels in 1966-67 than 
they anticipated in the previous school year. As a matter of fact, 
only 12 of the initial 17 who indicated this type of change actually 
did make the change | one of the 17 went to a different school, two 
persons stayed in the same grade and in the same position, and the 
remaining two did not respond to Checklist II , 

One of the most distressing aspects of action research in school 
settings is the lack of control over the movement of subjects: child- 
ren are promoted, schedules changed, families moved. Teachers are 
reassigned, participate in even newer programs, transfer, resign and 
of course, have babies. Even in those cases where the teachers’ move- 
ment is within the system or even within the same school, the move 
may represent a reward of be an expression of disfavor, and the effect 
on the teachers’ perspectives, behaviors, perceptions and attitudes 
cannot be predicted. This will be discussed more fully. 



Science in the School 



Participants were asked ”if there was a special science program 
in their school, to briefly describe any such special program and to 
indicate who was responsible for teaching science to the children in 
their class." 

Based on the 1966 returns for the year prior to the start of the 
Summer Institute, only five of the different schools had a program 
which may accurately be described as a special science program. Three 
of these schools comprise one group (#08) from a suburban school dis- 
trict involved in a departmentalized elementary-level program; in these 
schools science was taught by selected specialist science teachers. One 
individual (in group #C^) was involved in a team-teaching program and the 



Table 6 

Number of and Location of Teacher-Participants, by Group, for 

196^-66 and 1966-67 
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other participant (in group #03) was involved in a program described as 
"experimental," In all there was a total of nine persons in five dii- 
derent schools involved in a special science program. 

In almost each of the remaining 36 schools, OTPS, cluster teachers 
or consultants are used to supplement classroom instruction in science, 
although in none of these schools did there appear to be an org^zed 
program. It seems however, that each of the teacher-participants in 
a school using supplementary science personnel actually worked with them. 

During 1966-67 there was no substantial change in the number of 
schools involved in special science programs, although there was a ye^ 
small number of instances where participants discussed "science enrich- 
ment programs," indicating at least, some additional attption oeing 
paid to science. Although not every grade or class participated, there 
is some evidence that many more schools were tising cluster teachers and 
OTP's to teach science than had been previously noted; in addition some 
change was evidenced in the extent to which these personnel were now 
to be utilized throughout the school. This is not, however, necessarily 
a result of our Institute program but may reflect city-wide policies 
in the use of cluster teachers. 

T^Tiat is particularly heartening is that in many instances the par- 
ticipants we trained were being used as the science experts in the 
schools; in one school, all three participants became cluster teachers 
responsible for teaching science; in another school one participant 
taught science enrichment; in another, one became the science member 
of the team-teaching experiment; in yet another school a particip^t 
became the science coordinator; and finally, one sixth grade teacher 
voluntarily taught special science lessons to a fourth grade class when 
her (sixth grade) pupils "went to French". 

Participants were asked if they were "responsible for teaching 
science to the pupils in their class". An analysis of their responses 
for 196^-66 was made and the results tabulated in Table 7 (page 20;. 

One hundred and fifty-two participants, about 72 per cent of those 
resnondine to Checklist I, indicated that they themselves were direct- 
ly and primarily responsible for teaching science to their pupils 
during that school year. Sixteen per cent of the total was responsible 
for preparing and following-up science lessons taught by the OTPS or 
cluster teachers, and eleven per cent of the respondents said they had 
no responsibility for teaching science to pupils in thei r classro^^ 
(Included in this latter group are seven OTP's however, whose full-time 
responsibility was teachirxg science.) As evidenced by Table 7, ^ 

derences exist among groups; All respondents in group 03, 05 and 11 
tau^t science to the pupils in their classes while more than one- 
third of the respondents in groups 06 and 08 said they were responsible 
for preparing and follox-j-up lessons by OTP's. 

In 1966-67, based on the responses of the I60 participants return- 
ing Checklist II, approximately the same percentage, about 7u per cent, 
were responsible for teaching science to the pupils in their classes. 
The major difference was in the very much smaller percentage - about 
two per cent as conpared with I6 per cent - of teachers who wre re- 
sponsible for preparing their class and providing follow-up lessons 
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for the science OPP's, (see Table 8, page 20). In the 1966-67 school 
year. 20 per cent of the group, as compared with 11 per cent in 1905-00, 
said they were not responsible for teaching science to the pupils 
their classroomTTThis again includes the clusters and OTP s 
who teach scfince as a full-time responsibility, but who do not have 
their own class.) These findings substantiate the impression that there 
is a tendency to use our participants as science "eaqperts", cluster teach- ■ 
ers and science OTPsy rather than classrootn teachers. 



School patterns are interesting:' all respondents in group 03 and 
11 still teach classroom science as do groups the partlpipShts in 12, 13> 
and l5. Group 0$ now has more science taught by OTPs and cllister teach- 
ers as do groups 06, 08 and ih- A greater percentage of respondents in 
group 02 currently teach science to the phpils in theft' classrooms, as 
compared with the school year preceding the Institute i 



Interestihgly, those I6 per cent ( 0h&6]dl&tJ ) i^fespohsible for 
follow-up lessons indicated that they averaged as much time in instruc- 
tion in science as the group direcily responsible fob teaching the entire 
lesson. A comparison of average number of minutes pei* ^eek spent in 
science instruction was made for two subferoUps: (1) those that teach 
science and, (2) those that preparO for and follow-tip Science lessons. 

The results, reported in fable 9 (page 22) dt& presented to the nearest 
whole minute. Although there is, in general^ rto difference in time 
snent teaching, it wouHd seem reasonable to Conclude that the pupils 
inia^erserved bv science OTPs actually receive mofO minutes of 
science instruction than do pupils in classes where the classrom 
teacher teaches science. (Add the OTP lesson to the time reported for 
preparations and follow-ups.) 



An analysis of minutes per week of science instiniction was also 
made by grade level taught during 1965-66. The divisions for grade level 
Here K; grade 1-h; grade 5-6; special classes; OTP's, cluster ^achers. 
The results can be summarized as follows: teachers of grades p-o 

averaged 96 minutes per week of science instruction; teachers of grades 
1-U averaged 8l minutes per week, and kindergarten teachers averaged 
U9 minutes per week. Teachers of special classes reported the highest 
average; they indicated that they spent 102 minutes per week in science 
instruction. Of course, this comparison excludes the science OTP*s 
whose full-time responsibilities are science instruction. 



There were only 127 teacher -participants who ennumerated the num- 
ber of minutes per week spent in science instruction on both a^^^s- 
trations of the Checklist . Approximately U3 per cent of these iJ^^i^ated 
that they spent more time on science in 1966-6? than they did in 1965-oo, 
Twenty-three per cent spent approximately the same amount of time and 
the remaining 3h per cent indicated (partly because of reassignments, 
new positions, etc.) that they personally spent less time teaching 
science after the Institute than they had done prior to the experience. 
No other analysis of time spent in teaching science was attempted, and 
caution should be exercised in drawing conclusions: the wording of the 

question seemed fairly specific although the responses seem to indicate 
ambiguity in interpretation - we are not certain whether the respondents 
are reporting the time they spend or the amount of time of science in- 
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s'bruC'tiiOn the pupils in their classes receive. 



Tsble 9 



Group 



01 

02 

03 

01^ 

09 

06 

07 

08 

09 

10 
11 
12 
13 
Ih 
19 



Average Number of Minutes Per Week Spent in Science Instruction, 
196^-66, fot* Teacher-Participants Who Were and Were Not Respon- 
sible ioi* teaching Science 

' ‘ ‘ Follow-ufe ah(^ ^Preparation 



Teach Science 
5T Average N 
Mriutefe 



8 

6 

10 

1245- 

1^-K- 

11^ 

7 

12 . 
9 

Ih 

12 

11 

12 



7li 
61 
^9 
76 
99 
68 
lOi* 
68 
99 
92 
131 ^ 
t9 
82 
70 
7ii 



Tl 



Average N 
Minutes 



h 70 

8 83 

0 

1 79 
0 

3 107 

2 83 

b 

2 ilO 

3 75 

0 

2 68 

7 53 

0 
2 

Note: ^ One respondent in each of these groups did not complete the ques- 

tionnaire item dealing with amount of time spent in science instruction 
(Checklist I). 




Table 10 summarizes the number of participants who said that, 
during 1969-66, they taught science by itself or combined with other 
subject areas. Approximately 19 per cent of all groups combined - 39 
persons - taught science, before the Institute, as a separate subject 
area. The remainder of the respondents usually stressed one (about 
39 per cent) or several other subject matter areas. 

For the total group, the social sciences was the area most fre- 
quently reported stressed in the teaching of science, followed by the 
language arts (which includes reading.) Several of the teacher-par- 
ticipants reported that math and science were taught together. The 
differences between groups are interesting. For example, gr^ps 01, 07, 
12 and l5 stress the language arts while groups 02, OU, 05, Oo 09, 10, 
13, and Ih stress social studies. 

After the Institute about 21 per cent - 31 persons - of the total 
number of respondents said that they taught science alone; approximately 
U9 per cent taught science with one other subject matter area, and the 
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rgmining 1*5 persons (30 per cent) combined science with instruction 
in several other areas. 

Teacher-participants were asked to enumerate other (than teach- 
ing) special responsibilities relating to science in their schools. 

The intent of this question was an attempt to ascertain any changes in 
SmSn of teachers as a result of their KDEA Institute training, 
mis quLtion about science responsibilities was f 
as noted, seme respondents tended to misundersta^ the question an 
described duties other than science responsibilities. 

About eishtv-seven per cent, l86, of the respondents to this 
item on the cLcklist said that during 196^-66 they had no^other^s^^^ 
resnonsibilitiesT Twenty-six persons indicated that they had othe 
TcienS SnSkmiss! including seven OTP- s c^d eight Persons^ho 
taught reading, drama, art, as well as a j3n- 

responsibilities of these 26 participants help- 

tainine supplies and materials, serving on the Science Committe , p 
mgite sSence fair and preparing audio-visual aids and projects. 

During the year after the Institute approximately 83 
the isHeipondents to this item indicated that they had no other 

science responsibilities. About 17 per cent, ^hed 

that they had other science responsibilities si^lar ° °®.. ,, 

above (Of these, four described other than science responsibilities;. 
ThirtUn of the 26 teachers were new, acquiring these responsi es 

after the NDEA Institute. This substantiates again our topression o 
thrt effective use was being made of these HDEA trained teachers. 

The teacher-participants were asked to describe °f 

their schools' science materials, the effectiveness .®® ^ ^ 

field trips, experiments and supplementary teaching aids, and the lewl 
5 pupil interSt in science. (Analysis of the ®f'®™®f 3 

trips, experiments and teaching aids will not be included in ^®P 0 

Table 11 summarizes the percentage of respondents in each of 5 
groups rating their schools' science materials 
q*iate and less than adequate, for 1965-66 and again for 19 - 7. 

Although the groups differ in the number of schools f®P^®®"*®'*’ 
it was decided to discount this since we were interested 
teachers' oerceptions, and not necessarily in actual changes in science 

materials. It can be hypothesized “d smplies 

est in science may lead to dissatisfactions about materials and si^pli 

pr©viously considsrsd adsquat*©. 



Slxtv-severtLper cent of the total combined group of respondents 
(Checklist I) fSt that their schools' science materials was "adequate, 
about ll per cent described the materials as "very adeqi^te , ^d 2 
per cent L "less than adequate". In four 

L participant felt that the materials were more than adequate , wMle 
one^^third of group 06 described their materials as very ^equate. More 
?lSn Sne-?Lthrof the participants in group 12 rated their materials 
as being less than adequate. (See Table 11.) 



u 



Table 11 

Perceitage of Teacher-Participants, ^’roups, expressing Satisfaction with Schools* Science 

laterials 



1 











^er). asked to rate their schools* science materials after the 
Institute, the distribution of responses for the total remained about 
the same: approximately 11 per cent rated the materials "very adequate," 
6h per cent rated them "adequate", and 26 per cent rated their schools' 
science materials as "less than adequate". 

There were differences in group ratings. For groups 01, Oii, 11, 

13 and 1 $ the materials seem to have gotten "less adequate", while for 
groups 05 , 08, 09, 12 and lU the materials were rated somewhat more 
adequately after the Institute. If we assume that the materials them- 
selves did not change appreciably, how can these differences be ac- 
counted for? 

¥e can postulate that the participants, on the one hand, became 
more critical of materials previously considered adequate enough, and 
on the other hand, they became more appreciative and aware of the po- 
tentials of the materials previously considered merely adequate. 

Teacher -participants were asked to rate the level of interest in, 
and receptiveness to scdence of the pupils in their class. Ratings were 
made on a five-point scale, where 1 = uninterested, 2 = indifferent, 

3 = neutral, h = interested and 5 == avidly interested. The percentages 
of respondents, in each of 1^ groups, making each rating are summarized 
in Table 12. Pre and post -Institute ratings are presented as well as 
the groups' mean rating of level of pupil interest in science. 

During the school year 1965-66 teachers rated the pupils as "3»8", 
being "interested in science." After the Institute, the combined 
total rating of puipil interest was somewhat greater than "I1..O", "in- 
terested in science." Initially, three groups, 01, 03 and 12, rated 
their pupils 1|.0 or higher. The remaining groups ranged between 3*6 
and 3»9» Only one teacher rated the pupils as being "uninterested" in 
science, i^ile 13 teachers rated their pupils as having an avid 
interest in science. The rating of "1|" or "5" was used by 8l per cent 
of the respondents. 

After the Institute, approximately 83 per cent of the respondents 
rated pupil interest at "1*" or "5" on the scalej however the great 
shift, accounting for the higher post mean score, was in the increased 
number of participants using the five -point on the scale. The mean 
scores for groups 01, 03 and 11 did not change between administrations. 
Group II4, who initially rated pupil interest at 3»9j later lowered the 
rating. All other groups rated pupil interest higher after the In- 
stitute than they did before the Institute. (It is important to 
remember that the teachers were rating different groups of pupils the 
different years, althou^ there is no reason to believe that the 
nature of the pupil population in a school underwent a significant 
change. ) 

We can hypothesize that (l) the degree of interest in science did 
not change in the two populations rated by the teachers, or (2) that 
the pupil interest in science did change. If we accept the first hypoth- 
esis, we can attribute the better ratings in 1966-6? to a change in 
teacher perception of pupils. If we accept the second hypothesis that 
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■in 1966-67 pupils were actually more interested in science,^ we assume 
+Lt the^Ltrra oi’ the pupil population did not change significantlj^ 

^ can aUriSe batte/interL in science to a change in teacher be- 
havior with regard to science instruction. 

Science and the Teachc r -Participants 

Participants were asked if they felt equipped to teach science as 
school systems' curriculum giaide. Their responses, 
SrLd^ffor th^^ are tabulated below in Table 13 see 

page 29 ). About ^8 per cent of the total group ^ 

1965-6’6they did not feel equipped to teach science as outlined the 
curriculum guide. Thirty- five per cent of the total group did feel 
equipped to teach science, there was no response from abou seven per 
2 ^ <Trcup One vear later, after the Institute experience, 

8^06^ cent of the total group indicated that they felt eq^pped to 
?LcrsSeLf as outlined in the curriculum guide. O^y six per cent 
of the group did not as yet feel equipped to teach science. 

It is interesting to note differences between the ^5 groups . to- 
itially, there were some participants in each group, ranging from 20 
trt 89 ner cent indicating feelings of not being equipped to teach 
soieLL After the Institute there were nine groups where not one par- 
ticipant rated herself as not equipped to teach science; only 
eroiros were there participants who did not feel equipped for science 
teaching as outlined in the curriculum guide. In another section of 
thrcheoklist, several participants commented that they were not com- 
lort iblfa^l o^Ir in teaching science as outlined in the curriculum 
^^fthey described these guides as inadequate, and not process- 

centered. 

Since we had anticipated a number of teachers e^ressing_ general 
feelings of not being equipped to teach science, we included “ 
Checklists additional inquiries into specific areas of content and 
teolraiqueT Participants were asked to rate themselves on their. 

"Ability to examine trade books and select appropriate and 

pertinent conceptn.” .i_ • 

"Ability to plan siiqjle science experiences for their p^ii 

"Adeptness at designing and making simple materials, models, 

"Technical ability to use simple instruments and ^ 

"Ability to evaluate the extent to which their pupils have mas- 

tered a concept," 

"I&iowledgs of the physical sciences." 

"Knowledge of the earth sciences." 

"Kciowledge of tlia oiological sciences." 

The average ratings for each grovg; and for the combined total are 
presented in Table 1 ); (see page 31 ). Mean scores obtained before the 
Institute tend to range around the mid-point of the five-point rating 
scale. For the total group the average rating on "ability to examne 
trade books and select pertinent and appropriate concepts was 2.B. 

The highest mean rating ( 3 . 2 ) was on the item dealing with the parti- 
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cipants ability to evaluate pupil mastery of a concept; in general, par- 
ticipants rated themselves as having slightly greater than average abil- 
ity. A pre-Institutc naan rating of 3-0 indicated average ability to 
plan simple science experiences. Participants tended to feel they had 
somewhat less than average skill in using simple instruments (2.8), and 
between some and average skill in designing and making materials (2.6). 

In six of these ratings ‘group 08 had the highest mean and group 12 the 
lowest mean scores. 

Pre- Institute ratings of scientific knowledge - physical, earth 
and biological sciende - tended to cluster between '’some toowledge" and 
"average knowledge." For each of the l5 gJ^oups, mean ratings on knowl- 
edge of biology was higher than the ratings for either knowledge of earth 
or physical sciences* Other data tend to confirm feelings^ of greater 
confidence and competehde in biology as compared with physics and earth 

science . 

The same ratings were obtained on Checklist II administered one 
year later. For the total groups the ratings on each item ofireraged 
3.1, or somewhat more than average. The highest absolute rating of 3*7 
was on the two items dealing i/dth participants* ability to design simple 
experiments and their ability to evaluate the extent to which their 
pupils have mastered a concept. The greatest absolute increase in mean 
score were in knowledge of biological and earth science. Participants 
also tended to feel, c-f^er tne Institute, that they had somewhat more 
than average ability to examine trade books and to use simple instruments. 

Group 01 rated themselves better on all items, except for ability 
to design simple materials (no change in mean rating from first to 
second administration.) The greatest absolute gain for this group was 
in their ability to use simple instruments and equipment. Group 02, 
which made great abscliite gains between all ratings, indicated the 
greatest change in their Imowledge of earth science, and (relatively) 
least change in their ability to examine trade books. Group 03 showed 
the greatest gain in the item dealing id.th the use of instrments and 
equipment; prior to the Institute they were the lowest ranking of all 
groups on this particular item. Groups 0i| and 0$ indicated that their 
greatest improvement was in their ability to plan simple experiments, 
group Oii did not indicate much improvement in the use of instruments 
and equipment. 

For group 06, for example, the greatest absolute gain was in knowl- 
edge of earth science; they had the smallest change in ability to exam- 
ine trade books and select appropriate and pertinent concepts. For 
group 07 the greatest gain was in knowledge of earth science, as it also 
was for groups 09, 13 ^ and lh» 

For group 08 there were negative changes from the pre and post- 
Institute ratings. They rated themselves as being poorer in their 
ability to examine trade books and in their knowledge of the physical 
sciences. Little positive change was evidenced in their ability to 
plan simple experiments and to design single materials. Group 10 on 
the other hand, indicated largo improvement, especially in their abil- 
ity to evaluate pupil mastery of a scientific concept. Group 11 had 



Mean scores of Teacher-Participants, by Groups, on a Science Self-Rating Scale, Adininistered Before 

and After the Institute. 
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the greatest relative amount of change in their ability to plan siit?>le 
experiments, while for groups 12 and 1$, the area of greatest gain was 
in their ability to design siirple materials* 

In addition to these ratings, and as a check on them, participants 
were asked to specify those science topics or areas they felt best- 
equipped to teach and most-enjoyed teaching, as well as those areas they 
felt ill-equipped to teach and least-enjoyed teaching. A content anal- 
ysis of responses was made. Five broad content categories emerged: bio- 
logical science, earth science, physical science, social science (mis- 
cellaneous) and, teaching techniques. Within each classification several 
sub-areas were noted. Table 15 (see page 33) presents the frequencies of 
scorable comments by content area and the percentage that were described 
as best equipped-most enjoy and least equipped-least enjoy teaching. 
Although there were group differences, the results are presented for 
all groups combined. 

Of the total 912 scoreable comments obtained on the pre-institute 
administration, 3^2 or 37*^ P©r cent were categorized as physical 
sciences, 291 (31.9 per cent) as earth science, and 196 or 21.5 per 
cent as biological science. There seems to be an inverse relationship 
between the frequency of response in these three general areas and the 
percentage of ’’discomfort" responses: over eighty per cent of the biol- 
ogy responses were "comfortable" as conpared with 5^ P®^ cent of the 
earth science responses and 5l psr cent of the physical science responses. 

In addition to the knowledge content areas, there were some hh 
responses that seemed to fall in a technique category. These included 
statements about using materials and instruments, conducting discussions 
and leading observations, experimentation and small group work. More 
than three-quarters of these comments fell under the ill-equipped and 
least enjoy column. More than 90 P©r cent of the comments about using 
instmments indicated discomfort. 

There were several items that seem to be related to the social 
sciences: transportation, communication, and clothing and shelter. 
Participants were fairly comfortable in this area; about 60 per cent 
of the responses were of the best equipped-most enjoy kind. (Although 
the Checld.ists provided separate questions and spaces for describing 
topics and areas most enjoy and topics and areas best equipped to teach, 
as well as least enjoy and ill-equipped to teach, responses were grouped 
as indicated above. The rationale for combining them is that in just 
about every instance there was no difference in topics listed as best 
equipped and those listed as most enjoy teaching. ) 



On the second administration of the Checklist there were fewer 
respondents (as already noted) and fewer responses to this item. There 
was only a total of U57 scoreable comments, just about half as many as 
obtained in the first administration. Of these, l6^'^ about ijl per cent, 
were categorized under physical science, about 29 per cent earth science 
and approximately 23 per cent under biological science. 
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There was no change in the percentage of comments describing their 
comfort with "living things". The increase in percentage of comr.ients 
about being ill-equipped to teach "nutrition, health" may be due in large 
part to this area being neglected during the summer experience. 

A slightly greater percentage of the positive comments about Earth 
Science indicated somewhat greater comfort with this area as a result of 
the Institute, especially as regards astronomy, - the planets and space. 



A greater proportion of responses of the best-equipped, most enjoy 
type (as coirpared with the pre-Bistitue proportion) indicate that par- 
ticipants felt somewhat more at ease with the physical sciences, espe- 
cially, heat, motors and machines and air. 

Interestingly, in only three cases was there a greater number of 
total scoreable responses in the second administration as compared with 
the first - heat, clothing and shelter, and observation. 



The "techniques" category seemed to have undergone the most shift. 
Before the Ijistitute 23 per cent of tV.ese responses indicated that par- 
ticipants felt well-equipped to use materials, instruments, obsorvat.ion, 
exper'ii/jntatlon and smail groups. After the Institute, 62 per cent of 
the c j-nments indicated case and comf(5?.‘t in all arrias xjith the nctcable 
exception of "discussion-, lecture." As hoped, since they were to learn 
other techniques, 'particii.pants were not as comfortable with dicscussion 
and lecture after the Institute as they were prior to the Institute. 



The Institute and the Teacher-Participant 



The only official source of knowledge of the formal objec-’.l. v.s cf 
the NDEA Institute was contained in the descriptive brochure kwcU bhe 
part5.cipants received in the Spring of 1966, Fe iiere an'oeresrsc iii what 
the participants expected to learn and acccmplif=;a ( Chec ^J.lst Jlj and 
what they felt they actually learned and acoomplished du'-’lng the 
workshop. 

The rationale for the question was to provide some inf orr.>? tion 
about expectations, in order to con^jare parb, cilpfr.bs' e3;:7iecta’:v.Oiis and 
the expectations (objectives) of the planners of 'd).e Iiisl'itute. 



analysis of participants' ezp^^:;tevlons (Ch eckl ist I) was 
ummarized in Table 16 ( see poge Eac-i x'ssp^v^ee state- 

« m ft 



A content 

made, and is summary , ...... 

ment was broken down into its component par to ai.d each part we-wS tall.s,ed 
separately. For example, the statemerit "I want to learn more science 
to become an effective teacher" was tdlliec> once uader "Increase knowl- 
edge" and once under "to become a more effective teacher." 

The total group combined averaged (total nwher of comments div- 
ided by number of respondaiits ) sc.oreabl'^ ? d's. (fae Ta 'J.e l6, 

page 3u») The range for :lndiv.h‘.lual groups was x;C'.rr.. 2.2 (-^roup '.'0} to 
h»7 ({iroup 11.) There is sufficient evidence to tha’c some 

groups are consistently more verbal or fluent (quantity) than others. 
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An almost perfect, .997, rank-order correlation was obtained between 
average number of scoreable comments per group on this item as compared 
with average number of scoreable comments on the previously discussed 
item, "best equipped and least equipped". It would be interesting to 
carry the comparison further to determine the relationship between 
"fluency" and gains in scores. 

The single most frequent response as indicated in Table 16, was 
an increase in scientific knowledge and understanding, accounting for 
over 18 per cent of the total responses. Specific subject areas knowl- 
edges were also mentioned frequently - earth science (U.6 per cent of 
total responses), physical science (3*6 per cent) and biological science 
(1.5 per cent of total responses.) 

The second most frequently mentioned expectation was generaflized 
interest in becoming a more effective teacher. This type of response 
amounted to 11.6 per cent of the total responses for all l5 groups 
combined. "Learn to interest and motivate pupils" ojid ”To e^^loit 
available materials", followed, n-.— «i»^ng respectively for 8.2 per cent 
and 8.6 per cent of responses. About seven per cent of the 

responses wp’’'' anticipation of learning new experiences for pupils 
and^ip-*-^**^*^S the participants’ own interest, ease and confidence with 
Two expectations, learning to teach science to the disadvan- 
taged child and learning new teaching methods, each accounted for over 
five per cent of the tot^l responses; these categories in particular 
are not directly included in the objectives of the Institute. In fact, 
in some ways, all the expectations of the participants seem to be at 
slight varience with the objectives of the Institute, with the exception 
perhaps of change in the participants' ability to demonstrate knowl- 
edge of the biological, earth and physical sciences. The designers of 
the Institute planned that the participants gain skills and learn tech- 
niques for selecting, evaluating and exploiting - rather than being 
taught a specific selection, evaluation or exploitation. The differ- 
ence perhaps can be summarized as the difference between learning (par- 
ticipants' expectations) as conqpared with learning to learn (Institute's 
objectives. ) 



It is interesting to con^are participants' expectations with out- 
comes described by the participants one year later. In the final sec- 
tion of the 1966-67 Checklist j participants were asked to describe what 
they learned and accoit 5 )lished through their experiences with the NDEA 
Institute. They were also queried about special personal (science) 
strengths and/or weaknesses exploited, or corrected. 



In general, participants were most verbal and direct in answering 
these questions. The range of responses was quite in^jrossive, from 
wholesale approval to di::5 approval, from specific suggestions to gerxeral 
effects, from immediate changes to long-rar.g- goals and from helpful, 
inforr.^3tive experiences to vague generalizivi-ions. As anticiprl.ad there 
was a small group of responde''ts -who indj.c?';ed that "the ex]:<e.’iencs 
was a total here", "it was totally Wf.rthlr!:-.s ', "I learn'.:! how not to 
get parlclng tickets", or "it was wor >.rful’' , "I d'hiu't v,iiss a. single 
day ev.jn though I T/as siok", "I am eternal L .7 gra*’ ciul fc/’ the exper- 
ience" and "it should continue forever and everyone should be a par- 
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tlcipant." 

On the other hand, there were a list of specific coiranents and accom- 
plish^ts mentioned. These included such diverse as “olo^ 

K,r^nA bad" "nhysics good, earth science bad"ji etc#, as well as, 

ftaSi hL^ ise"^^io!visuai equipment". "I le^ed how_to use a 
microscope", "I learned about hot and cold experiments , and about 
snakes" etc. Also there was another type of response that may be 
described as rather generalized: "Information in ^ 

"learned new methods", "learned how to demonstrate", "didn t learn 

enough information", etc. 

As anticipated there were individual differences and some differ- 
ences that appear to be characteristic of groups. There were s^ris- 
ingly few indiscriminant feelings and comments. 

included suggestions to group homogeneously (group 0^, 01), use qualified 
instructors (group 01), learned only what "I „ 

individual projects were good»(group 03 , 01, 07), learned U 1 
nothing", "didn't learn to teach better" (group 0^, 13). 
ceptloL of the respondents in groups 02, 10, 11, lit 1^, there was 
at least one participant in all other groups who may be characterized 
as generally dissatisfied with the experience as a totality. 

The positive comments were much more interesting. Each group, 
without exception, mentioned having increased their knowledge about 
science information in general and about biological science in par- 
ticular. Most groups also discussed teaching science, some saying 
they learned how to teach more effectively - 

what is appropriate to a specific grade level, more J; 

teaching science, learned how to interest pupils, learned to 
good lesson, leaJ^ed to give good demonstrations, learned how to dis^ 
cuss science, etc) - and some saying that they did not learn how wO 
teach science better, that the Institute was not successful in chang- 
ing teaching methods, etc. 

They also discussed, pro and con, but primarily favorable, the new 
materials presented to them and more importantly, learning sources of 
materials. One or two comments indicated that there were instances 
during the school year where participants constructed their own mater- 
ials: one person mentioned developing a bibliography of science read- 
ings for children during the 1966-67 year. Most of the persons who com- 
mented about learning how to use equipment reacted favorably. There 
were three or four comments indicating that the teachers trained in 
the Summer of 1966 were helping other teacher sin their schools, imo 
had not had the NDEA experience with experiments, demonstrations and 
specific suggestions on how to teach science. 

The most important changes were changes in co^idence, attitudes, 
interests and enthusiasms, a decrease in fear, an increase in curiosi y, 
better ability to exploit everyday and natural phenomenon, a change in 
pupil participation, an appreciation of science as both 
and as an approach, more individualized experiences for children 
interest in current scientific theories, etc. 






Without exception, every group and most if not all of the partici- 
pants in every group mentioned greater feelings of confidence with sci- 
entific theories, with materials, with instruments and with ideas as a 
direct result of the Institute. Some of the comments included "I now 
teach science more often”, "I realized that I knew enough science to be 
able to teach", "I can now present even difficult concepts to children . 
Many of the comments were generalized and extremely opt^stic *• J ^ 
more relaxed, less fearful", "More confident", "my attitude toward sci- 
ence has changed". 



More importantly however, was the great number of respondents who 
spoke about overcoming distaste - notably distaste in h^dling 
things and instruments. One teacher "overcame squeamishness , pother 
increased confidence in working with living things, another spoke about 
her old fear of trying new things, another spoke about her new science 
orientation", others were simply "somewhat more confident, less fearful . 
One teacher in particular described herself as more "courageous", and 
another learned how to care for "and love" classroom pets. 



With the increased confidence emerged two important results, an 
increase in curiosity and an awareness on the part of the participants 
of how children are effected by the teachers’ attitude. Several par- 
ticipants indicated that as a direct result of the Institute they were 
currently engaged in reading and research in specific areas on their 
own. Some said they were reading science books, one was now subscribing 
to Scisnc© News^ soveral said they themselves learned **how to earn ^ 
became "more curious", more "science - minded". In addition there were 
several comments indicating that some participants learned soni© s® 
tific theory, were able to coordinate their ideas, got a better grasp 
of science, cleared up old misconceptions, learned about 
vances and learned how to reevaluate their own abilities and limtat- 
ions. Some spoke of learning that "science was an approach to ttiink- 
ing", others now con5>lained of the limitations of existing curriculum 

guides. 



There were several instances where teachers noted an increase in 
pupil ability to handle living things as a result of the ^®acher over- 
coming her own distaste; some said that they "learned that cMldren c^ 
learn"; another "learned that the attitude of the teacher influences the 
children", and that "teachers* attitude can make science interesting . 



There were many mentions of being able to involve and interest 
pupils, of learning specific things (demonstrations, experiments, etc.; 
that children responded to, of learning effective ways to present sci- 
ence to children - especially young children. There were a few dis- 
coveries; one participant was surprised at her prior underestimation of 
her pupils’ ability to deal with scientific concepts, while another 
mentioned that she now realizes how much children can learn. Other 
participants spoke about being able to more adequately evaluate how 
well a child is learning. 



Of great value to the participants was the realization that there 
exists all around and all the time, a wealth of natural experiences 
through which children learn, and how important it is to exploit these 
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phenomena. 

The resoonses about individualized activities and pupil participation 
i«tloIte ^tisfaction about one of the most ir?.ortant objectives of the 
Ix^erieLes there is some data available that indicates that at 
teachers actually will adopt this "technique" to the class- 
room^ Firstly, many teachers spoke about the value of pupil participation 
»rin<^Si.rLperiences L being the single best thing they learn- 
ed; S^fsaid merely that they learned it, ccyer^ that they le^ed 

how to "get pupils to do it" and others verbally .. 

tance. lome^responses were striking however: several teachers said they 
were more confidLt in allowing pupils to participate and to ^ 

some said that their children now knew "how to obse^e > 

Vs + +v->o ^mnnrtflnce of "Discoverv" but some actually said they can 

"f ,£5- 

other than science"! A few said that p^tioipation “ 

ron'» Two oarticipants spelled it out in detail - they said that tney 
were* able to^tolerate, understand and encourage the noise and apparent 
"chaos" involved in small group work and individualized pupil par 

pation. 



RESULTS OF THE SOPERVISOR-PARTICIPAMT SCHOOL CHECKLIST 

In March-April 1966 and 1967 each of the fifteen supervisor-par- 
ticinants received a School Checklist to be completed as part of the 
evalLtion, for the purpose of providing additioml ^ 

the role of science in the schools and more In^portantly, reflerting 
^y In that role as a result of the Participants ' ^er^ce 

in^the NDEA Institute. A copy of the forms used is appended. S 
Appendix C. 

Each stroervisor was charged with filling out a separate Sch^ 
Checklist fOT each of the different schools efed ^ the te^cber^ 

mrtic lgints in his group. As previously noted (see section descriwng 
the fifteen supervisors and supervisory groups), the participants c^e 
“dSfeSnt schools. Due to ^he large number of non^^^^ 
to the teachers' Checklist II , from which school affiliation is det^^^ 
mined it is impossible to accurately determine the number of ^fferen 
^Soois cu^^Uy represented the participants after completing the 

six week Institute program. 

. Pre-Institute returns of the School Checklist ”sre cyleted by 
nine of the 15 supervisors ( by four of the seven ®f|rtant principals, 
two of the three teacher - leaders, and by three of the five coor 
dlnators) and covered 18 separate schools. Fewer returns weire avail- 

?or Cyeariotlowing the Institute. Six supervisors (five of the 
nine who retwned Sc hool Checklist I and one coordinator *o did not 
eomolete School ChecJaist I_ ) returned forms for eight separate schools. 
For^^only six of these eigET schools was there ^ If^ing. 

Results will be presented separately for each of the six schools fo 
whi.ch pre - and post - ratings are available. 
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One coordinator indicated no difference in weekly time alloted 
to science instruction and no difference in the amount of time spent 
in teaching science. This school had had a state-certified librarian 
and there was no change in the percentage of science books in the 
library. Prior to the Institute, an OTP comprised the primary science 
program; after the Institute, the materials introduced in the i^jrork- 
shop were widely used throughout the school. The science storage 
closet developed into science storage "areas.*’ Pre-Institute there 
were enough supplies, materials and equipment for individual pupil 
experiences - after the Institute there was no longer enough. Level 
of interest in science in this school, as rated by the coordinator, 
changed from ’’average" to "above average interest in science." The 
NDEA trained teachers, in particular, had a greater interest in science. 

A teacher-leader, ,iri describing his school, indicated that 
although the current weekly time allotment for science is less than 
the time alloted prior to the Institute, the time spent in teaching 
science is left largely to the teachers’ discretion. There was 
no change in percentage of science books in the school library al- 
though the school now has a state-certified librarian. There is current- 
ly and had been, a special science closet to store materials - 
materials enough to allow for individual pupil experiences. Before 
the Institute there was less than average interest in science in 
the school and a heavy emphasis on reading achievement; as a result 
of the Institute there is a Science Fair and the level of interest 
in science has improved. 

One Assistant Principal completed School Checklist s for one 
school. He describes the greatest over-all changes, and ascribes 
the changes diredly to the Summer Science Institute. Before the 
program in this school there was a science OTP; during the current 
year all five of the teacher-participants from this school are 
science cluster teachers doing most of the science teaching. The 
year before the Institute, science supplies, materials and equipment 
were kept in three closets; they now have a special science room. 

Most of the teachers, before the Institute, were "fearful of teaching 
science, taught Ijttle science," and as a result there was somewhat 
less chan average interest in science in the school. The school is 
now described as "science oriented" and each class meets for at least 
two sessions a week wd.i:h the science specialists. The most tilling 
feature hoT^ever, noted by the Assistant Principal, is the presence 
of live animals and fisli in the classroom. 



A second coordinator completed two sets of forms for three 
different schools. He noted an increase in weekly time alloted 
to science in each of trie sch-.ols arid at each grade level. There was 
no change however in how sciei.-.ce materials were stored or main- 
tained; there was no special loom either before or after the 
Institute in any of these schools. In twv; schools the percentage 
of science books in the l.ibrary increased and there were enough 
science materials, although civi.ldren are still not encouraged to 
work indepei'dentlv, Ii' two schools there had been adequate itaterials 
to work with: after the Jnstitate the. rati-.;ig changed - there are 
not enough materials, su pplier, and equipmsub to meet individual 
pupils' experiences. In general, this coordinator notes little interest 
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in science and insufficient science teaching. 
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From the sketchy data available and the vague nature of the 
responses it is difficult to make any definitive statements although 
one does get the impression that supervisors do not reflect the 
positive attitudes generally found among the majority of the teacher- 
participants. In general the supervisors do not see great changes^ 
their attitude is neutral; the teachers, on the other generally 

express over-all satisfaction and more optimism. ¥hile the supervisors 
tend to limit the more positive aspects to the participants themselves, 
the participants evidence a greater feeling of change permeating the 
entire school. Interestingly, the one teacher-leader and the one 
Assistant Principal who completed the School Checklists saw more wide- 
spread benefits than the coordinators; perhaps these people are closer 
to the school, especially the every-day aspects, and are in a better 
position to estimate changes. 



RESULTS OF THE CLASSROOM OBSERVATI ON OF THE TEACHER-PARTICIPANTS 

Development of the form: After an exhaustive search of the avail- 
able literature on behavior schedules it was decided to develop our 
own behavior observation form specifically related to the objectives 
of this Institute. A copy of the form Used in the study is appended. 

See Appendix J* 

The development of the observation schedule underwent several 
editions, each tried out by the team to use it. Differences in mean- 
ing and interpretation were discussed until it was felt bhat some 
consensus had been reached* Before the schedUle was uded in a class- 
room the two observers rated several KinnesCoped recordings of class- 
room teaching. At that point we felt that observer agreement was 
fairly strong; however there were certain biases and disagreements 
that were not resolved and the final fdrm of the schedule includes 
many items that reflect individual bias. 

The form itself consisted of three pages and mechanically was 
simple to use. On the first page the observer recorded the name of the 
teacher, the school, grade and class, the room number, the data and time 
of the observation, the number of pupils and his initials. Space 
was provided to indicate how the lesson was introduced and how the aim 
of the lesson was developed for the pupils. ¥e were interested 
primarily in three things; (1) pupil understanding of the aim of the 
lesson, (2) teacher ability to incorporate diverse, fa\miliar exper- 
iences, and ( 3 ) teacher ability to encourage pupil participation)j. 

In fact, (2) and (3) form a basic thread through the design of the 
schedule, reflecting the Institute ’.s interest in pupil participation 
and in the "discovery" approach to science instruction; other threads 
included individualized instruction and en^hasis on process-centered 
activities. 

The second page of the instrument stressed the teachers' skill 
in using a variety of instruments, techniques and materials during 
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different parts of the lesson, her skill in conducting the "e^erorontal" 
Dart of the lesson, her working knowledge of the factual basis of the 
pStic^S lesson end nor ability to integrate tiiis lesson with other 

experiences, both academic and not. 

We were concerned mth how teachers question their pupils and what 
they do Sen a pupil asks a question, items dealing with this type of 
exchange are grouped on page three of the schedule. We also included 
some over-all judgmental assessments of 

as well as the quality of the session and the nature of pi«)il involve 
ment. 
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aSte^prS°°Sl^‘'Sr^tte the MDEA Institute, provision 

was made for classroom observation of the teacher-participants; once 
before the Institute, once again immediately after the Summer experience 
and a third observation some time later in the school year. 

It was impossible to visit each of the 221 teacher -participants. 

A sample of three participants in each of 13 groups (we excluded the 
two groups from outside the Hew York City system) was selected from 
^nflZse participants who taught science in grades K-U. ^ 

made for three visits to each of the 39 pre-selected participants: 

Two observers together visited each of the teachers. Supervisors ^re 
consulted and a calendar for the first set of observations P^®' 
Dared. Each participant involved in the observations received a letter 
informing them of the date of the visit and the intent of the observation 
great care was taken to assure them that the observations wo^d be con- 
fidential (no one but the evaluators would see the individual obser- 
vations), that they would not be used to evaluate their perfoni^oe as 
teachers, but rather to provide a before and afto meas^e of the effect- 
iveness of the Institute on the classroom performance of ^e Partici- 
pants. ¥e feel that we did develop their trust; however it should be 
noted that among New York City teachers there is general dislike of 
being observed and attendent unease and suspicion. 

We had decided to visit three participants in each of the tMr- 
teen groups to allow for attrition of subjects d^ng the following 
vear* we also felt that three would provide a fairly good s^le on 
Lioh to base the analysis. We decided also to try to retain the same 
order of visits for each set of observations; Uotually there was a 
76 rank-order correlation between the order of the first and second 
rtsits) for the third set of observations one member of the too-man team 
was unable to coaplete the school visits. This r^ort will deal pn- 
marily with the first and second sets of observations. 

The pre -Institute observations took place in March -April 1966, and 
were all completed before the Spring recess; '‘^® 

served for the second time during Septeraber-October ^66 and again 
during March 1967, approximately one year after the first visit. 

A total of thirty-eight of the selected participants wre observed 
during the first visit; there ware two teachers absent, but in one case 
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another teacher volmteered to be obsei^ed. Of the^ 
by both observers. For the second visit observations ^0 
were completed. Of these 30 was included one not seen originally y 
onfor^he team members. In other words there were 29 teachers ^o 
were observed twice, each time by the two-man observation team. Three 
of the original 38 had di-opped out during the Institute, one transferred 
t a^thor^schooi, oho .Jin r»aternity leave, one ^ “fr- 

of music , another was absent and one teacher-partioipant refused to per 
Mt“obSrvatioh to be conducted. The main body of the resuWs 
be based on the two sets of observations of the 29 Remaining participant 



PAass and Grade Comparisons? . ^ ^ 

There was oi^sidera&e chMge in grade ahd 
the vear befofe the Institu-be and the year following the Institute. Only 
17 of the°29 participants taught the same grade during the two school 
ylars. In addition, four teachers who ori^nally f f 

classrooms became cluster teachers, one other was assigned a special 
rSIboup, three more went from a kgher grade level to a lower 
grade level, and four from a lower to a higher grade level. ®ach of 
thpse however agreed to teach a science lesson for our benefit.) Even 
™ tL 17 who remained at the same grade level, five who had taught 
the highest class on that grade were now teaching the lowest classes, 
and only nine stayed with the same level* 

This reassignment of teachers helped make the before tod afier 
compaSstos so mLh more difficult: The^obserVers very di^ 

ficult to compare the behavior of a teacher teaching a bright t i 
grade with her behavior in a very dull and uninterested 
aass. Some further provision for teacher reassignment should be bmln 

into the planning of observations; either ask g 

the same wade for the before and after year, or limit the observations 
to those who volunteer to stay with the same grade class for toe two 
years involved or thirdly, observe a very much larger san?)le thto nec- 
essary and then follow-up those who do remain with toe same grade. 



ten gto of Lesson Observed ; 

There was good agreement between observers on the length oi ne 
science lesson observed. In the few cases of disagreement the average 
time was used as the basis for the following discussion. 



The range of time for the first observation was from l6.0 to 
no,nutes with the majority of the lessons lasting 

The range of time for the second observations was somewhat longer, from 
llo Sutes to U6.0 minutes. For 12 teachers the second lesson lasted 
an average of ^.38 minutes longer than the first lesson; for 16 persons 
the first observation was longer by an average of ^.09 minutes; one per- 
son taught the same length lesson both times. 
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Topic of the Science Lesson 

t=Mp T7 fsee cage li6) summarizes the topic of the lesson tau^t 
at thf Srst a^Hecold observation. For the pre-institute o^servat^ 

ss™sr» S” 23“ 

? 4 * 4 -vi oomnrt time Only two persons taught the same topxc during 

to?h"hflirsr"c;nd‘^LrvatLns, one on electromagnets and one 
on air (air in water and then plants need air.; 

they were best-eq^ped on-invpd” Of the 29 teachers observed, 

they ^re taught neuural 

topics tLch and slac taught topics they 

ta^ht topics feyff At tS second observation, ten taught neutral 
topicf si taughf Siba they oHginally felt at ease «ith and seven 
tdugh^^ topics they were originally ill-equipped for. 

Much more Interesting however is the <=»^“g%®tSeS'^li^SverS 
from the nrst to the second “^se^io^ SlSmS best to a neutral 
i.e., went frota a best to an /j„- 4 r»£, v,n+h sets of observations, 

u.= sirs'—iss/srs 

ill -equipped topics both times. 



ers - when being observed - per cent of the lessons 

were familiar with,_ For the first already 

developed topics. There was disagrej^ena ^tout^^°’^/®“ ^re 

time there was observer topics appeared to have 

new, 53 per cent young and f ° f ^ observation, 

been pretty well-developed by the time of the seoona oos 

In 28 per cent of the cases ^*^^„^TeSSSeiSlS 

to the same point for °^®®^^i|gi.ent^egrees, indicating perhaps, 
to present lessons developed to diffe t d whatever they "were 

that they taught more naturally, i.e,, y b 

up to." 
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^?aEs^ -“oleSforiSgSS tSSSSS lls^tXe 

k 3? JeS tTor treats SfSrit^SS^SSd “ cU °thf second 




The mean rating of one observer (A) was U.285 the mean rating for 
the second observer (3) was 3.28 indicating that he judged the aim as 
much less clear to the pupils. For the second set of observations , ob- 
server (B) had a mean rating of 3.2U, slightly lower than 
rating. Observer (A) had a mean rating of U- 3 somewhat higher th^ 
his initial mean rating. For both observers combined the initial mean 
rating was 3.78; at the time of the second visit the combined average 

rating was 3.79. 

Using the average of the two observers’ ratings, seven teachers 
exhibited no improvement in how clear they made the aim of the lesson 
to the pupils; nine teachers tended to make the aim more clear the second 
visit and 13 teachers were rated higher for the first visit th^ fo 
the second. (For each observer separately the ^ 

comparisons differ; for observer (A) there were 11 . .A 

in rating, 8 cases where the aim was less clear the second visit than 

it was the first visit and 10 cases where, the second time, the aim 
wL ^re clear to the pupils than it was the 

(B) there were seven teachers with no change in rating, 12 teachers 1*0 
were rated lower the second time (more vague) and 10 cases where hey 

were rated hight the second time (more clear). 

In general, taking into account observer ^sagreement, 
not seem to be much change in the teachers’ ability to make the aim o 
the lesson clear to the pupils in the class. 



Ho w Aim Was Developed - I mposed to Elicited; +hp 

Ba t.-ing g ware made on a 5-POint scale where 1 = teacher m?)Osed the 

aim to 5, teacher elicited the aim from the pupils. 

Initially the combined rating averaged 1.59 (observer (A) = 1*93 
and observer (B) = 1.2it. ) For the second set of observations the com- 
biLd average rating was 2.0k. However, observer (A) 's mean rat^g ^s 
1.81;, lower than the initial mean rating, and observer (B) s mem rating 
rose dramatically to 2.21;. For the first observer (A), there were 11 
cases where the rating did not change, 9 oases ^".*^;h^the^3econd ^^ 
rating was lower than the first and 9 oases in which toe seoo^ rating 
was Mgher - more elioited than the first. Observer (B) recorded 12 
no change in rating, two cases where toe rating was "poorer 
imposed) the second time and 15 oases received a ^sHer ra ing e 
seLnd time. It is difficult to state conclusively the mount, if any, 
of change in the degree to which the Institute affected the classroom 
ability of toe teacher to elicit the aim of the lesson 
in the class. However, a sub-analysis yields some interesting resets, 
toerfis a tondency for teachers to elicit the 

she is teaching a topic neutral to her or for ^ch she has invested 
that she feels ill-equipped to teach as ooit?)ared to those topics sh 
feels comfortable teaching. The inverse tendency seemed to obtain 
after the Institute. , .. 

At any rate, even using the highest raters' Judgments, the 
were still low on toe scale; after trairdng the teachers were not highly 
adept at eliciting toe aim of the lesson from the pupils. 



Table 17 



Frequency With i-liich Teacher-Participants Taught a Content 
Area During the First and Second Classroom Observations 



Topic 


First Observation 


Second Observation 


Sound and Vibration 




2 


Senses (nose) 


1 


- 


Air 


h 


2 


Living things, needs of 


h 




l^agnets and electromagnets 


h 


3 


Plants, parts of... seeds 


2 


1 


Properties of water 


2 


1 

h 


Magnifying glasses 

Weather, instruments, clothing. 


etc. 


Electricity 


1 


2 


Balance 


1 




Friction 


1 




Rocks and sand 


1 


X 


Shadows 


1 




Won-food farm products 


1 


- 


Making butter 


1 




Salt 




1 


Gravity 




1 


Scientific Attitudes 


- 


1 


Total 


29 


29 


Inttenduction of the Lesson^ 


, Topic and Aim; 





Fe were interested in noting how the teacher introduced the lesson, 
whether she used materials, instruments, textbooks, ether printed mater- 
ials, •'"i'^ual aids or c. verbal introduction integrated with the use of 
any of the materials, 'f'^e were also interested in whether or not the 
materials, instruments, etc. were limited to those things found in the 
classroom or whether she introduced experiences from the home and com- 
munity. 

Observer agreement was generally good. In the first set of obser** 
vations there was minor disagreement in four instances and in the second 
set of observations disagreement was limited to three subjects. (In 
cases of disagreement, an average was devised.) 

Table 18 (see page hi) summarizes the introduction of the lesson 
at both the first and second observations. The most striking aspect of 
the comparison is the increased diversity in types of introductions used 
after the Institute experience. 



hi. 



Tr.blG n 



Frequency of Types of Introductions Used by the 
Teacher-Participants, .First and Second Observations 

lint, T.P^aon ^3 Introduced: ' Fi rst Observation SecoM UDservati on 



Use of materials with verbal integration 

Use of materials and visual aids, 

verbally integrated 

Use of other printed, visual aids, 

verbally integrated 

Visual aids verbally integrated 

Verbal introduction only 

Other printed material, verbally 

integrated 

Use of materials, other printed, 
verbally integrated 
Instruments, visual aids, verbally 
integrated 

Instruments with verbal integration 



10 

2 

1 

7 

7 

2 

0 

0 

0 



5 
3 
0 

10 

6 

1 

2 

1 

1 



The same increase in variety is noted in Table 19. Before the 
Institute, 17 of the 29 participants used verbal exayles, experiences, 
materials and aids from the classroom, five more used experiences ftom 
the school. Only four and three teachers ^ed home rad oomuri^ 
neriences respectively. In the lessons after the Institute, 1« teachers 
used classroom experiences and materials; the remaining teac ers use 
greater variety of sources than was apparent in the observations con- 
ducted prior to the Institute. 



Table 19 

Frequency of the Use of Exar^les in the Introduction 
of the Lesson, First and Second Observations 



Source of Materials, Instruments, 
Examples 



First Observation Second Observation 



Classroom 

School 

Classroom and School 
Home 

Community 

Other 

Class and community 
Home and community 
Class* school and community 



17 

0 
h 
3 
0 
0 
0 
0 



18 

0 

1 

0 

0 
1 
1 
3 



The appropriateness of the Introduction was rated on a 5-point scale 
where a rating of "1" indicated the introduction was inappropriate to 
the aim and, "5" indicated the introduction was very appropriate to the 
aim. There was a 66 per cent agreement in ratings between observers* 
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foT the first set, and a per cent agreement for the second set of 
observations. Using an average of the observers* ratings, the rat^g 
of appropriateness was U .38 initially; immediately after the Institute 
the combined average rating of appropriateness was Ii.lo; for each 
server separately there was a decrease in average rating from the first 
to the second observation. For nine teachers there was no change in 
combined average rating; there were nine teachers whose rating improved 
in the second observation and 11 whose rating was higher the first time* 

There seei^*^? some indication that the participants may have sacrificed 
appropriateness for elaborateness of introduction; it is probable that 
as the teacher becomes more familiar with the technique there may be a 
better reconciliation. 

Grouping ; .. , . . . . 

Two types of ratings of grouping of pupils were made; (1) whether the 

children worked as a class, or whether they worked within functional 
groups, and (2) whether or not the type of grouping used was appropriate 

to the lesson. 

If the classroom had movable tables and the piqpils normally sat 
around tables, (as is the case in most of the primary grade classrooms) 
this was scored as "whole class" group. Those cases where every child 
worked independently in his usual seat were also scored as "xdiole class;" 
only those situations where grouping was functional to the purpose of 
the task was a score of "groups" made. 

During the first set of observations, 2^ of the participants taught 
"whole class" groups, one arranged a functional group situation and two 
other teachers combined the whole class and grouped class for different 
activities. In one instance there was inter-observer disagreement. 

At the second observation there were 21 participants who taught 
the "whole class as a group," four teachers who used functional groups, 
three teachers who combined both techniques, and one instance of ob- 
server disagreement. Looking at the individual performances there were 
seven participants who changed their method of grouping from the first 
to the second observation. 

In 72 per cent of the ratings of appropriateness of the grouping 
(first set of observations) the observers agreed; for the second obser- 
vation there was only agreement in per cent of the cases. Further 
comparisons were made using the average of the observers* ratings. Kie 
mean rating for appropriateness of grouping for the initial observations 
was I 4 ..O 9 , and for the second set, it* 36. Each of liie observers* ratings 
increased. For 1$ teachers the rating was higher the second time as 
compared with the first, for seven teachers there was no change in 
rating and for the remaining seven the rating of appropriateness was 
lower for the second set of observations as compared with the first* 



Planning; 

In only 19 of the 29 (first) observations did the observers agree 
on whether the main activity of the lesson was a teacher activity, pupil 
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activity or pupil experiment. Eight were rated as primarily 
activities (demonstrations, lectures, etc.), eight rated as primely 
pupil activities and xhere were three instances of combined teacher- 

pupil activities. 

■ i 

For the second set of observations there was disagreement in only 
six cases: in 19 instances the observers agreed that the priory portion 
of the lesson was a pijipil activity, in one instance it was clearly a 
pupil experiment; tico teachers combined teacher-pupil activity and only 
one teacher planned a lesson solely around teacher activity. 



Punil Opportunity for Pl anning : ^ 

Pupil opportunity for planning was rated on a scale where 1 m- 
dicated^no pupil opportunity; indicated much pupil opportu^ty and 
"5" indicated too much opportunity allowed pupils; in planriihg the 
of the lesson. There was agreement feetweeh observers in t6 per ^ent ^d 
per cent of tbe first and second observations respectively. In oiay 
LroHL total of 116 ratings made (four for each of the 29 teachers) 
was a rating of "3” or higher used, indicating that this item does not 

discriminate well* 

Using the average rating oi the observers* ihe 
first observation was 1.393 f'b'' "losn score, for the second observation 
was l.h8. Seventeen baachers received a higher rating, i. el* allowed 
pi^ils more opportunity to plan* the second ,, 

teachers whose average rating did not ch^g? and three who gave pup 
more opportunity to plan before the Institute. 



Teachers' Ski ll in Conducting Plannifag ; 

Observer agreement in' r'ating teachers' skill in conducting pla^^ 
was generally poor; there was agreement in only 21 per cent of the first 
set and it? per cent of the second set of observations. 

Using the average of tha two observers’ rating, the combing score 
was 3.53 and 3.60 for the first and second observations respectively. 
Hox-iever, only one observer (B), actually noted an increase in rating^ 
Based on the averaged observer scores, 12 teachers did not demonstrate 
any change in skill, nine teachers had higher second rattags, a^ eight 
teachers were rated lower the second time as coipared with the first. 



Punil Opportunity to C olleot Data - Type and D ata Collecte4;_ _ 
jS^nts ranging from "teaoner only" to "too much , were 
the opportunity of pueils to ooi-leot data and on the type - descriptive 
or quantitative - of data collected. Agreement was good. 



For the first sot of observations the combined raters' score was 
3.U3; on the second set the score was 3.67. Each observer noted an 
increase . 



I 

the 



There were 27 instances of descriptive data and one instance, during 
first set of observations, where the data was clearly quantitative. 
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(There was disagreement in the rehiainiilg case.) During the second set 
of bbseirvations there were 28 instances of the collection of descriptive 
data ahd one instance iri which both descriptive and quantitative data 
wet*e coiledted* 

Publl Opportunity to Organize Data Systematically ! 

Ratings were made on a 5-poiSt scale where ”1" indicates that only 
tke teacher or^ari.zed the data and "5" indicates that pupils had too 
much opportunity to org^ize the data. Agreement between observers' 
ratings Were 52 per cent in the first set and 38 per cent in the second 
set of observations. Both observers noted somewhat increased pii^^il 
opportunity during 1966-67; using the combined score the average rating 
WAs initially 1.90 - the average rating for the second visits was 2.10. 

3ji the initial observations there were 26 cases where the organ- 
ization of data was descriptive, one case where data was organized quan- 
titatively and one instance of disagreement. In the post-institute visit, 
26 teachers were rated as organizing the data descriptively, one teacher 
who combined the descriptive and quantitative organizations, one teacher 
who made no attempt to organize the data at all, and one instance of 
rater disagreement. 



Interpretation of Data ; 

The observation schedule allowed the raters to judge who inter- 
preted the data - teacher primarily, pupil primarily or joint inter- 
pretation - and whether the interpretation was dogmatic -absolute, proba- 
bilistic or inconclusive (not enough information available to make a 
decision). 

In 19 visits the observers agreed that the interpretation was 
dogmatic-absolute, in three cases they agreed that the interpretation 
was probabilistic in one case, inconcluscive, and in the remaining cases 
there was disagreement. 

Seventy-seven per cent of the dogmatic interpretations were made 
by the teacher, ll^ per cent by the pupil, and the remaining nine per 
cent were joint interpretations. Forty- two per cent of the probabil- 
istic ratings were made by the teacher, h2 per cent made primarily by 
the pupils and S per cent resulted from joint interpretations. 

In the second set of observations, observers agree that l8 of the 
interpretations were dogmatic, two were probabilistic and in one case 
the interpretation was rated as inconclusive. 

Fifty-six per cent of the dogmatic interpretations were made by 
the teacher, lii per cent by the pupils and 30 per cent were joint inter- 
pretations. Of the probabilistic interpretations, 56 per cent were made 
by the teacher, 33 per cent were joint and 11 per cent of the interpre- 
tations were made primarily by pupils. 



teacher Questions: . . ^ 

We were interested in whether the Institute had any effect on the 
quality and quanult.y of teacher questions, believing that skilled ques- 
tioning is a teciuilque intrinsically related to encourag.vng pupil Par- 
ticipation with special relevancy to the d:».scovery approach to teaching. 

Fe included in the instrument two scales, one 5-point scale on 
frequency of quesivlons asked, and another 5-point scale on the teachers 
skill as a question asker. We also noted whether the questions were p 
warily factual-definitional, explanatory-predictive, or procedural. ^ 
addition we indicated whether the paipose of the question was to f^^er 
thraesson, for evaluation, or an attention-getting, disciplining device. 

Since one observer rated teachers' questions as factual-definitional 
in 81 per cent of the cases observed, agreement between observers occured 
only when the other observer made the same notation. More iif?5crtan 

however, observer (B) noted no change in purpose ° 

ers, and observer (k) noted only 10 teachers whose type of questioning 
did not seem to change from the first to second set of 
There was some increase noted in the number of questions rated exp 

atory -predictive . 

Both observers noted an increase in the frequency ^th which 
questions were asked during the observations after the 
bined observers' score for the pre-institute sessions ^s 3*45, 
the post-institute sessions, 3.66. Eleven of the ii^vitol ® 

were rated as questioning their pupils more frequently after the m- 
stitute than they did before the Institute. 

The teachers were rated as fairly skilled questioners; before the 
Institute the averaged observer score was 3.86; after the Institute the 
teachers were rated 3.91. (Observer (A) rated the teachers as more 
skilled than did observer (B).) 

There was observer agreement only in those cases where ^th ob- 
servers agreed that the intent of the questions were to ^*^rther the 
lesson, primarily because one observer consistently made this type of 
judgment. The first rater did note an increase in the Percentage of 
questions designed to evaluate pupils' knowledge after the Institute 

experience . 



Teachers' An swers to Pupil Questions : 

Teachers were ratedTcn (l) their attitude in answertng pupils 
questions (from "discourages pupils" to "encourages pupils' questions ); 
(2) the manner in which they handle questions from pupils (from P^ys 
no attention" to "gets pupils to answer their ojm 

and (3) the degree of teacher tolerance and criticalness with questions 
(from -"intolerant, overly critical" to "overly tolerant, uncritical. ) 

Agreement between observers ranged from 3k per cent to 69 per cent; 
in general there was better agreement on the first set of observations. 

Initially (combining and averaging observers scores) the mean score 
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on teacher attitude toward questions was h.l9i after 
raters noted an improvement, the mean score was U.3U. 
dividual teachers were rated better the second time. 

change in either how teachers handled pipils L^JSs 

ance for questions. In the former instance one observer rated teachers 

poorer thi second time while the other observer f . 

higher. The opposite vns true in the case of toler^ce ^ criUcalness^ 
the combined zvorage score was 3*1^4 ^or the first and 3«1 v. 

^t of observations, both scores reflecting that generally the teachers 

were very tolerant ^ appropriately critical* 

There was much "better agreement between observers on how the lesson 

ended. For the first set of observations there were W inst^ces of 

lessons ending with a summary review of the ^re'^kve 

board, on an oaktag chart and/or in pupils' notebooks. There tere five 

observations wldch ended in a pupil test, usual^ a rexographed t^ 
reviewing exactly what they had been taught, (to ?"® ® 

test of a scientific concept, using examples md Z „ 

taught.) to two instances the lesson ended abrvpoly; oiie xn. ^ 

homework assignment and another case where P^®«®/’®’^® "f Sth 

davs ' session in the library. Seven teachers ended the lesson 
"g^e", eating butter, drinking Kool-aid, playing 

tellons, and drawing or coloring pictures; three of these activities 
were specifically related to the aim of the lesson# 

There was no discernible teacher pattern the second tire teat could 
be related to the first set of observations; the 

lesson ends (under conditions of being observed) seems to be d^enden 
on too many other things, e. g., assembly periods, use of clusters, 

restlessness of class, etc. 

In the post-tostitute observations there were ll; teachers who gave 
a summary review, one who gave an oral question ^d te^^. 

abrupt ends, three teachers primarily involved rtte cleaning * 
teachers who assigned homework and discussed future plans, and 
instances of drawing and other games. 

Most of the teachers ended the lessons differently both ^ 

general the differences represented 

ending to a homework assignment or from a homework assignment to dis- 
cussion of plans for the next science activity. 

Both raters generally agreed that in ending the 
tended to answer the original questions. In general, most teachers who 
initially answered the original question continued to do so after the 

Institute. 

Bote raters were in agreement that the majority of the teaches ^d 
not raise new questions in ending tee lesson; the 

were only eight instances where the observers agreed teat she did. *lle 
S^th^eLId observation, raters agreed that 10 teachers did raise 

new questions* 
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Teachers were Tidrly poised when they were visited initially; one 
observer rated them as confident, the other as somewhat more than "at 
ease." There was agreement in 59 per cent of the ratings. Both raters 
noted a sli^t increase in poise for the second visit and agreed on 
the rating in 62 per cent of the cases. 

The teachers' attitude underwent somewhat of a decline; this was 
noted by both observers. Initially their mean score was U. 26, more than 
"good." On the post-Institue observations the mean score was u.22. 

Initially, the quality of the session was between "good" and 

"very good"; most teachers taught a better session the second time - the 
mean score (combined for both raters) was 3»79> almost, "very good". 

As for pupil involvement, there was generally high inter-rater agree 
ment. The mean score on the first set of observations was U.1.2, on the 
second set of observations, 1^.22. Most teachers were rated as improved 
in their ability to involve their pupils. 



The above analyses of classroom observations of the group of 29 
teacher -par ticipar >3 seen prior to the Institute and again taiediately 
after the Soiiimer experience do not adequately rexlect the flavor an 
character of the observations. 

In general we were well received; although most of the partici-pants 
if asked, would probably prefer not having been observed, they welcomed 
us graciouruy, and the majori.ty of them were ver;/ much at ease, we saw 
fairly good science lesions being taught; of course, the good teacners 
were good before the Institute. In the less adequate teachers, there 
was always some irqjrovement, either in the scope of the l®sson and the 
variety of the experiences presented to the pupils, or in the^ skill 
in organizing and planning. Several teachers who initially t^ed ^ «o 
too much, too many activi.ties, afterwards 'vyere able to simpl-fy and direct 
the lesson. The strongest over-all impression was a change in tether 
willingness to experiment as noted in the greater variety of activities, 
contents of the lesson, as well as a general feeling that teachers were 

more flexible. 

Conparisons were difficult to make because of the reassignment of 
teachers described above, and the fact that the 29 participants 
twice may be biased in favor of being a more cooperative groyjp than the 
39 selected or of the group of 221. 

Certain behaviors, when summarized for observers, did not change 
much, although in each and every instance some individual teachers did 
change. Whether these represent no real changes cannot be determin^ 
because we saw a rather small segment of behavior, ''•b can charac ei ze 
these behaviors as the general teaching behavior j, unrelated to science 
teaching. For exair?)le, there was little over -all change in teachers 
ability to put across tlie aim of the lesson, although there was sligh 
iuprovement reflecting their atten?>t not to Inpose the aim on the pupils. 
Tn general, neither before nor after the Institute, were teacher par- 




ticularly successful in allowing pupils to participate in the plahning 
of the lesson, teachers* skill in planning was not significantly changed; 
however, obsex^ver inpression does not support this “ we strongly feel 
that the lessons x^ere better x>l-^Jined the second blme a J.bhough it is 
extremely probable that the tc Acners did not spend as r.iuch effort on 
formal planning the Post-Institute sessions. 

Teachers were not particiilarly skilled in any of the areas where 
pupils were expected to participate - in collecting, organizing and in er- 
preting data for example - nor in the manner of questioning pupils an 
responding to their questions. 

Most changes occurred in the following: after the Institute there 
was a greater diversity of topics; in examples and experiences intro- 
duced during the lesson; a better attempt at having the pupils manipulate 
materials and providing enough materials for each child’s independent 
use; more attempt at developing and using functional groupings of child- 
ren in the process of instruction; a slight decrease in the absoluteness 
of interpretations and an increase in the number of instances xdiere 
pupils participated in the interpretation of the data. Teachers tended 
to simplify the lessons, to do fewer different things in the course of one 
session and to direct the lesson to the specific aim. They were 
more able to allow pupils to touch materials, play with materials. The 
materials became more interesting: live animals instead of models; 
postage stands and coins to peer at through the magnifying glass rather 
than a page from a textbook. Teachers were better able to tolerate con- 
fusion, the confusion that seems to exist when all pupils are doing 
something. Everyone seemed happier. 



RESULTS OF THE EIEI'dENTAHY SCIENCE SURVEY 

The Eleme ntary Science Survey , developed by Teachers College, 

Columbia University is an iih item multiple-choice test originally designed 
to diagnose science iweaknesses and strengths. The test yields eight 
sub-scores and a total composite score. The subscores are: Astronomy, 
Nutrition; Earth Science; Machinery; Materials and Energy; Physicax 
ErMronment; Biological Environment; General Science; Elementary Science. 

A copy of the Survey is included in Appendix E. 

Two additional subscores, an Institute and a Non-Institute sub- 
score, were conputed. The 8I4 items were divided into two groups, ( 1 ; 
those taught in the Institute and (2) those items not directly covered 
in the Institute curriculum. The breakdown was submitted 0 "n 

visory Committee who agreed on the final decisions. Items # 

13, lU, 16, 17, 18, 20-22, 25, 30, 32, 3 ii, 36, 37 , 39 , k0-h2, ^^ 50, 

53 , 5 U, 58-60, 6I4, 69, 70, 73 , 76 comprise the Institute score, the 
remainder comprise the Non- Institute score. The highest possible 
Institute subscore was 33 ; the highest non-institute subscore was 51 . 

The Survey was administered to the teacher-participants as part 
of the test battery at the beginning of July and again in August after 
a six -week interval. The same form of the test was used for both ad- 
ministrations. The following analyses are based on the results of those 




56 . 



participants, 218, who con 5 >leted both administrations. 

Table 20 (see page ^5) summarizes the mean< • score for the total 
group of teacher—participents c^n both administrations. Included in the 
table are the eight subscores and the two specially devised Institute 
scores . 



All scores, with the exception of the Nuitrition sub-score, were 
significant at the .01 level of confidence. 

Interestingly enough, the mean difference in the Non-Institute score 
as well as the Institute was highly significant, although the larger 
standard deviation of the former indicates somewhat greater variability. 
However, it is important to note that there could not be adequate con- 
trol over what was, and what was not taught within supervisory groups. 

It is of course extremely possible that certain groups actually became 
involved in subjects outside the scope of the perscribed curriculu\im. 

It is expected however that this would have occured on a random basis. 

Of the eight sub-tests the greatest mean gain was in Elementary 
Science, followed by Earth Science, Biological Environment and Physical 
Environment. 

Ifean scores and measures of variance were con 5 >uted for each of the 
l5 groups for each of the sub- tests as well as for the conqposite scores. 
The t-test statistic was computed and the results of these con?)arisons 
are presented in Tables 21 through 23. 

Tables 21 and 22 summarize the mean score for each group on each 
sub-test for the first and second administration respectively. Group 
11 had the highest initial total score of ^0.07 followed by groups 
08, 02, 05, 01, 15, 07, 13, 03, 06, Ih, 10, Oh, 12, and 09 with a mean 
low score of UO.66, a range of more than nine correct items. On the 
second administration group 06, gaining an average l8 points, had the 
highest total mean score, (61.66) and group 09 had the lowest score of 
liU.OO, a range of 22 items. There is a rank-order correlation between 
groups of .79 on total score for the first and second administration; 
if it were not for the exceptional final performance of group 06 the 
correlation would have been much higher. 

There is a strong tendency for those groups who score higher on 
the Institute score to also score high on the Non-Institute score. For 
the f3.rst administration the rank-order correlation was .6? 5 for the 
second administration the rank-order correlation was .81;. 

Table 23 summarizes the average gain between administrations for 
each group on each subtest and the significance of those gains. For 
this report, any t-test that does not reach the .05 level of confidence 
is not considered significant (N.S.). 

The range in gains on total score is from 18.13 for group 06 to 
3.50 for groups 01 and 10. (Note that the gain is significant for^ 
group 01 but not for 10). There were two groups, 10 and 11, who did not 
perform significantly better (total score) on the second administration. 
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There were many significant gains in Earth Science and Ele^ntary 
Science; six and five groups had statistically 

each sub-score respectively. Only two groups gained sig^fic^tly i 
knowledge a:bout Nutrition as compared with three groups in Astronomy 
and Machinery, Ma,terials and Energy, 

There were differences between groups that should be noted: Group 
06 showed significant iit^rovement in seven of eight 
group 15 in six of the eight. Groups 03, 0$ and 13 “^^^owed sig^fic^t 
inrorovement in four of the eight subtests; grou. and 02 in ^owc of 
the eight. For groups 01, Oh, 0? and 08 there were only three subtests 
that reflected significant gain, for group 09, two subtests. Groups 
10, 11 and 12 each had one statistically signi.ficant 2 S>r. Note that 
the three groups led by peer-supervisors, 01, 08 
fairly little significant change in scores. Generally, the groups 
supervised by coordinators were among the groups making tne most sig- 
nificant gains. 

In interpreting these results it is of utmost impor^ce to re- 
member that the same form of the test was used in both admirdstrations; 
there is no information available on the practice effects, m tnis 
evaluation in particular, practice effects may be 

beca\:ise of groups remembering questions and discussing possi p 

with the help of the supervisor. We tried to forestall this as 
as possible by making certain that all test booklets were returned 
end of the testing session so that direct reference to a specific 
question was not possible. We can only assume that different gro^s 
"recalled" different questions at random so that the effects of usinj, h 
same form of the test would be somewhat reduced, 

RESULTS OF THE TEST OF SCIENCE CONCEPTS 

The Test of Scie nce Concepts was specially constructed to evaluate 
the specif5r^>jeStives of the Institute in the absence 
ing more relevant instruments. In particular, what ^ 

was a measure of science understanding and problem-solving a i y, 
of knowledge in several pre-selected areas of biological, earth and 

physical science. 

It was decided to atten?)t to construct an inst^ent that 
measure reasoning and problem-solving in science. The 
ing con?)rehension tests provided the model - a passage followed by 
questions about the passage. Two passages in each area of biological, 
earth and physital sciences were written. The final instrument 
consisted of a total of six passages each followed by seven questions. 
The quesUons, multiple-choice, were based on information contain^ i 
the passages however, in order to arrive at the correct answer one 
had to deduce it from the information provided. In othw words, the 
"rieht answer" itself was not directly incorporated in the passage 
(unlike the reading comprehenri.lon test) but all laformaiion 
to determine the correct choice was made a-ailab^e. Another 
deparrore from the standard reading ooii?)rehension format ras in the 
untimed administration of this Test of Science Coneggts. The ^ , 

passages in the final version appeared in the following numbered order. 
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(1) Helative Motion, and (h) Catalysis (earth science); (2) Change of 
kase, and (^) F « M X A (physical science); (3) Tropisms, and (6) Food 
Chains (biological science . ) Each passage could be scored separatej^y . 
Th^ of the passages, one in each area, (1) relative motion, (2) change 
of phase and (3) tropisms, conprise the "Institute subscore, 
to be taught in the Institute. The remaining contc?.t passages 
and (6) were not included in the Summer curriculum, and constitute the 
"Non-Institute subscore." In addition, a total score on the Test of 
Science Concepts was obtained. A copy of this Instrument can be found 
in Appendix D. 



Tjhe Te st of Science Concepts was administered to the total group 
of teacher-participants as part of the beginning and end of Institute 
test battery. The same form of the test was used. Only the results oi 
those participants who completed both administrations, 218, were used 
in the analyses which follows. 



The highest possible sub-score for each passage was 7.00, the total 
number of possible correct responses: The highest total score was 42 . 00 . 

Table 2h (see page 63) summarizes the scores on both administrations 
of the Test of Science Concepts for the total group 

billed. The tot^ test score for the first administration was 25.10; on 
the second administration, six weeks later, the mean score was 2o.o^, a 
statistically significant gain of 2.3U points. 



Taking the average number of correct responses as a rough index of 
difficulty, the most difficult passage for the participants on the l^rst 
admlnistratioii was "Catalysis", followed by "Relative Motion" - the earth 
science topics. Next in difficulty were "Change of Phase" and F - M X A , 
while "Tropisms" was the easiest passage; the entire group averaged 
5 . 3 U correct of a possible 7.00 on the Tropism sub-score. 



For the total group the "Institute Subscore" (Relative Motion + 
Change of Phase + Tropisms) was 12.80 as compared with a Non-Instpute 
subscore of 12.29. For the second administration there was a 2.3U 
gain in the Institute Subscore and a l.l|0 gain in the Non-Institute 
Subscore. Both subscore gains were significant at the .01 level of 
confidence. 



Although all sub-scores for the combined total were pignificantly 
higher on the second administration, the greatest absolute increase n 
score was in Relative Motion (1.1*3) and Change of Phase (o 75). Tropisms, 
the third content area comprising the Institute Subscore, exhibited une 
smallest gain of (o*l6); this is most likely due to the very high initial 
mean score and the restricted variance. 



The significant gains in "Catalysis", "F * M X A" and "Food Chains , 
as well as in Non-Institute subscore may be attributed to ^y one or 
combination of the following reasons: (1) The gain may be due simply to 
practice, test-rotest, effects; (2) The gain may represent a true change 
in learning how to solve all problems in science; (3) The gain may be 
due to exposure of these unplanned contents within supervisory groups 
during the course of the Institute. (The gains in Institute Subscore 
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may also of course, be due to the same reasons, but because the gains 
in these scores tend to be greater and for a larger number of individual 
groups (see Table 27), there is some basis for attributing these to the 
Institute experiences rather than to testing procedures.) 

Tables 2^ and 26 (see page 6h) summarize the mean score on each 
subtest for each of the 1^ groups on the first and second administration 
respectively, of the Test of Science Concepts . Group 11 had the highest 
total score, 29.3^, on the first administration, followed by groups 05, 

15, 02, 08, and 13. Groups 12, ih, 09, 10, and 03 were the poorest per- 
forming groups on the first administration. There is a ,9h rank-order 
correlation between total score and Institute Subscore for the first 
administration, and a correlation of .85 between Institute and Non- 
Institute subscore, indicating that some groups to start with knew more 
science than did other groups. 

In general the groups retained the same relative position on the 
second administration of the Test of Science Concepts; the -^ank-order 
correlation between Institute -subscore was .76. The greatest shift in 
relative position was for group 11 who went from highest Institute- sub- 
score on the first administration to eighth highest score on the second. 

Table 27 (see page 66) summarizes the mean difference in score 
between administrations for each of the l5 groups on e^ch of the sub- 
tests and the statistical significance of each of the differences. Gen- 
erally, all groups obtained somewhat higher scores on the second admin- 
istration; Group 10 increased their total mean scores by 9.^8, and group 
06 by 7.73 points. Significant increases in total score was also ob- 
tained for groups 02 (lie27)> 03 (3«>80)^ 05 (2eltl), 07 09 (2el3)^ 

12 (1.53), 13 (i^.08), Ih (3.66), and group 15 (3.60). vath the ex- 
ception of groups 06, 10 and 15 all groups had a greater gain in Institute 
subscore than in their Non- Institute subscore. For groups 06 and 10 
both subscores showed statistically significant gains at the .01 level 
of confidence; for group 15 the significant increase was in Institute 
subscore only. 

Eight of the 15 groups showed significant gains in "Relative 
Motion" and five showed significant gains :* i "Change of Phase". For 
the remaining sub-tests there were no more than three groups who gained 
significantly on each. Comparing the number of groups who averaged 
better on the Institute subscore with the number of groups who changed 
significantly on the Non-Institute score, the results are inpressive; 

For thirteen of the l5 groups the growth in average score on the 
Institute subscore was statistically significant. For only four 
groups was the increase in Non-Institute subscore statistically sig- 
nificant. 

These results would seem to indicate that the Institute was 
effective in increasing scientific knowledge and problem-solving ability 
in those areas that formed part of its curriculum. Althou^ there 
were increases in scores in those science topics not directly covered 
during the Institute, these increases in general are not significant 
and may be largely attributed to the test-retest procedure involving 
the use of the same form of the Test of Science Concepts. 
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Groups that did relatively best on the second administration of 
the Test o f Science Concepts tended to also do better 
administration of thi T ^li^tary Sci ence Survey (rho='.66), 
ingly, there is little relationstip ror une groups between gains on the 
Test of Science Concepts and gains on the Element^ 

'those groins" that increased their perfommce most on the Test of Sci^ ee_ 
Concepts were not the same groi^is that gained most on 

Scie^ ~Survey. The rho correlation between chan^ was . 36 . These_results 
W inplicaE'ons about the ceiUngs and bases of the tests. It wo^d 
appear more difficult to increase your final score if your initial j-core 
was hiche Actually, on the Test of Science C oncepte there is a Mg 
negatiTO rank order correlation, - .OB, between score ^d 

anJunt of gains on the Elementary Science ® 

but insignificant rho correlation, .2<!, between initial score and 

amount of gaine 



RESULTS OF THE ^MEASURING MEANING” TEST 

We had assumed that New York City teachers were 
teaching of science with maiQr of the fears, omcems and ^stastes ttat 
were evidenced in the area of mathematics, and as a res^ 
much science, or did not teach science well. We assumed 
teachers' attitude and understanding of science and 
influenced her behavior in the classroom, her am perform^- 
and her general feelings of ease and comfort. We telieved f^ven 
concrete scientific information, expert support and encowag^nt^ 
an opportunity for self -experimentation, our participants would evidence 
both a "change of heart" and a "change of minde" 

As noted in the two proceeding sections, the "change of mind proved 
easier to measure, 

A search of the test literature revealed two tests lAiich 
to mets^rauKs toward science, the TOUg.Tjst (Test on 
ing Science) by W. W. Cooley and L. E. Klopfer, and the Facte Abqut 
^ence Test by Glen Stice, et.al. ’ft>on_ol<> 2 e__inspeotion neith er in^^ 
strument seemed suited to our purpose. The TOGS Tes t,for \ 

a "best answer" test of "general knowledge about science, 

Li the L^in which sclLtists do their work." It contained questions 
such as: "Lhn Smith is a very imaginative young person. ®® f ^ ^ 
become a scientist because (a) he would not want to give ^ . 

of thought; (b) imaginative people “su^ly become artiste ^d^ters; 
( 0 ) he Lght Uke some other field better than science; (d) science is 
too factual for John," 

It was decided to investigate a technique developed by C . 
and others and pubUshed in 1957 in The Measure ment °f_ 

HI.; University of Illinois Press. This technique, one ^ 

ferential," seems to measure the meaning of concept s. It h . 

In a varikv of research studies, from a cross-cultural study to deter 
mine the similarity of factors of meaning in different languages to 
evaluating the public ima.g6 of commodities# 
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^ Significant at the *01 level of conficence 
■JHi- Significant at the *05 level of confidence 
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Osgood used three dominant factors, (I) Evaluative, (II) Potency 
and (III) Activity, and an equal number of scales for each factor. Below 
is an example of these factors and some scales representing them: 

I, Evaluative: good-bad, kind-cruel, beautiful -ugly 5 

II. Potency; hard-soft, strong-weak, masculine-feminine; 

III. Activity: active-passive, fast-slow, excitable-calm. 

Each adjective pair, following Osgood’s format, con 5 >rises a seven-point 
bipolar scale. These adjective scales were to be used by each subject 
to rate a concept that appears on the top of the test booklet. The 
instructions, as developed by Osgood, asked the respondent to indicate 
how he felt about the concept in terms of the scales. 

Some changes were made in order to more adequately suit this 
technique to our purposes. The major adaptation was not using the 
factors of Potency and Activity, which do not appear to have maximum 
relevance to the concepts we were interested in but retaining the 
Evaluative factor (there are previous findings that the ev^uative 
factor is the most reliable and also the most valid factor). J. C. 
Nunnally in a study. Popular Conceptions of Mental Health; Their 
Development and Change. New York; Holt, Rinehart and ^’Inston, 1961, 
de^ioped" the factor of Understandability which we decided to use. 

Ten bipolar scales were selected, five having high loadings on^ 
the Evaluative factor and five heavily loaded in the factor identified 
by Nunnally as an Iftiderstandability factor. The scales follow; 

Evaluative U nderst andability 



The ordering of scales and the polarity of direction is kept con- 
stant for all participants but in the actual administration the order- 
ing of concepts differed. Although the "favorable” sides of some 
scales are at opposite poles, in the scoring, all th^ favorable poles 
of all of tho scales were assigned the same score. 

Ten concepts were chosen to cover a broad range; These ten con- 
cepts were; (1) Scientific Knowledge (2) Itself as a Science Teacher 
(3) Science Instr\iments and Materials (li) Scientific Investigations 
by Pupils (5) My Teaching Skills and Techniques (6) Elementary 
School (7) "Difficult" Students (8) Process-Centered Activities 
(9) Disadvantaged Children, and (lO) Individualized Science Activities. 
A conplete san^jle copy of the instiomient and instructions for use are 
contained in Appendix F. 

The semantic differential was administered at the beginning and 
end of the Institute as part of the battery of tests. The data were 
hand scored and hand processed. Although Osgood suggests the use of 
a "generalized distance formula" in the analysis of results, based on 
the work of Nynnally and others, we decided to use the t-statistic of 



valuable -worthless 
inters sting-dull 
important-unimportant 
pleasant-unpleasant 
hard-east 



orders :l-chao iiic 
unpredictable-predictable 
mysterious -understandable 
complicated-siirqple 
familiar-strange 
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differences to determine whether or not there were any significant changes 
^ in the meanings of the concepts before and after the Institute. The 

i# t-tests employed here are based on the same differences in scores used 

in the generalized distance formulaj the later takes into account 
however, the entire profile produced by the groups. 

All analyses were computed for supervisory groups, but results are 
presented for all groi 5 )s combined. (Results by groups are available 
but will not be presented in this report.) Any mean difference in 
score which does not reach the .05 level of confidence is not considered 
statistically significant. Only the scores of participants who complete" 
both administrations were used in the analysis of results. A score of 
1.0 was used to designate the favorable pole of scale; a score of 7.0 
represents the unfavorable pole of the scale. A neutral meaning, or 
an irrelevant scale meaning, was assigned to the mid-point, U.0> scale 
position. 

Table 28 (see page 68) presents the results from both administra- 
tions of the Semantic Differential, summarized for the combined groups, 
for both factors and the ten scales. Although the mean difference in 
scores between administrations are small, each, due to the large number 
of cases involved, is highly statistically significant at the .001 level 
of confidence. 

The concept, 'Difficult Students" received the most unfavorable 
initial mean rating of almost U.O; after the Institute experience this 
particular concept had been changed, but remained the most unfavorable 
of the ten. On both administrations, "Disadvantaged Children" was the 
second most unfavorably rated concept. On both the initial and final 
administration Teaching Skills and Techniques" was rated most fav- 
orably, although "Science Instriiments and Materials" showed the great- 
est absolute mean change. 

"M(y Elementary School," included as a base concept on which to 
compare the others, remained as predicted the most stable of the ten 
concepts, i.e., we did not expect this concept to change: (the mean 
difference between administration was 0.1^). 

The next two tables. Tables 29 end 30 present the initial and final 
mean scores for all groups combined on the Evaluative and tJnderstand- 
ability factors respectively. The evaluative factor score is as noted, 
based on the scores of the valuable-worthless, interesting-dull- im- 
portant-unimportant, pleasant-unpleasant and hard-easy scales. The 
Dhderstandability factor score is made of the remaining scales: 
ordered-chaotic, unpredictable -predictable, uysterious-understandable, 
ccmplicated-siraple, familiar-strange. 

Again, and probably attributable to the large number of cases 
involved, each concept became statistically more favorable on the total 
Evaluative factor. See Table 29, page 70. Again the most stable 
concept was "Ify Elementary School," with a mean difference of 0.13 
(significant at the «01 level). 
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Initially, "Scientific Investigations by Pupils" was the most val- 
uable, most interesting, most in5>ortant, pleasant and easiest of all con- 
cepts — and it remained as the most favorable concept on the Evalu- 
ative factor. "Difficult Students" was the most unfavorable concept 
at the start of the program, followed by "Process -Centered Activities" 
and "Myself as a Science Teacher". At the end of the summer, "Diffi- 
cult Students" was still rated most unfavorably (with the third smallest 
amount of absolute change in mean score), while "Ifyself as a Science 
Teacher" and "Process -Centered Activities" became more favorable in 
relation to the rest of the concepts. As a matter of fact, both of 
these concepts showed the greatest absolute of change between admin- 
istrations . 

The concept of "Disadvantaged Children" is worth special consid- 
eration. Although the NDEA Institute was organized for teachers of 
disadvantaged children, the directorate was firmly committed to the 
position that "children are children" and sound and adequate proced- 
ures for teaching science should work as well with all children. 

However, it is felt that the teacher-participants themselves started out 
with the position that there "must be special methods, techniques and 
procedures for teaching the disadvantaged child." During the course 
of the Institute the participants were never directly instructed in the 
philosophy of the adndnistration; of course, by implication they were 
to have come to similar conclusions of their own. After-all, they never 
received instruction in special techniques for the disadvantaged. 

However, based on the results of the Effectiveness Rating Scale and the 
comments in the Checklists < the "neglect" of the ciisadvantaged ^as a 
disappointment to them and they felt that the Institute was ineffective 
in IMs area. 

The mean scores on the concept of "Disadvantaged Children" clearly 
reflect this. On the Evaluative factor (all scales), the initial score 
was 2,^h; the absolute change (although significant) was very owall, 
O.li;, and the final mean score was 2,k0, This concept ranked sixth most 
favorable on the first administration and ninth most favorable on the 
second administration. 

Table 30 presents the combined data on the scales compi..sing the 
Under standability factor. All mean scores, both initial and final, 
are higjier (more unfavorable) than the comparable scores on the Eval- 
uative factor. And with two exceptions, "Wjyself as a Science Teacher," 
and "K(y Teaching Skills and Techniques," the mean changes in scores 
between administrations were greater on the Understandability than on 
the Evaluative factor. Again, all mean differences in score were hi^ly 
significant. 

For the total group, "Difficult Students" was the least uy»der stand- 
able of the concepts, both initially and finally. This was followed by 
"Disadvantaged Children." On both administrations, the concept of "Ify 
Teaching Skills and Techniques" was rated most favorably, and "Wyself 
as a Science Teacher" was second most understandable. 
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Elementary School” had the smallest absolute change, although 
it was statistically significant. The greatest absolute change in 
Under standability was for "Science Instruments and Materials," followed 
by "Scientific Investigations by Pt^ils," "Individualized Science 
Activities" and "Process-Centered Activities." It is interesting that 
these are the very factors which reflect the primary theoretical founda- 
tions of the Institute. 

The scores on each of the five separate scales comprising the 
Evaluative factor is presented in Table 31 each of the ten concepts. 

Initially (and on the final administration as well) "Scientific 
Investigations by Pupils" was the most valuable of all concepts, and 
"Ityself as a Science Teacher" the least valuable, followed closely by 
"Difficult Students" and "M/ Teaching Skills and Techniques." Signif- 
icant changes in worth were obtained for all concepts except "Science 
Instruments and Materials" and "Disadvantaged Children." The g;reatest 
absolute change along the dimension of valuableness was for "^self as 
a Science Teacher" and "Ify Teaching Skills and Techniques." It is 
inportant to note that these are the most personal self -related, of all 

the concepts. 

On the interesting-dull dimension, the participants felt initially 
that "Scientific Investigations by Pupils" was most interesting, and 
"Individualized Science Activities" next most interesting of the ten- 
concepts. On the other side, "Process -Centered Activities" and "Ify- 
self as a Science Teacher" were both viewed as relatively more dull. 

^ the end of the Institute, "Individualized Science Activities" was 
rated most interesting and "Difficult Students" least interesting. 

The changes in mean score for Elementary School," "Difficult . 
Students," and "Disadvantaged Children',* were not statistically signif- 
icant; these concepts did not become any more interesting or dull than 
they had been at the beginning. The relatively greatest absolute mean 
gains were in the two concepts, "Myself as a Science Teacher" and M7 
Teaching Skills and Techniques." "Process -Centered Activities," 
originally most dull, also showed large absolute gains and a shift 
toward being more interesting. 

The changes in the dimension of importance substantiate some of 
the findings and interpretations. For exairple, there were no signif- 
icant changes in inportance score for "% Elementary School" po change 
expected here), "Scientific Investigations by Children" (originally 
viewed as the most iuportant), "Difficult Students" and "Disadvantaged 
Children." The concept of "Disadvantaged Children" actually became 
more unimportant, although not statistically so, at the end of the 
Institute — perhaps reflecting the point of view held by the admin- 
istration. The changes in "Jfyself as a Science Teacher" was greatest, 
followed again by "Process-Centered Activities." 

Neither "My Elementary School" nor "Disadvantaged Children" 
changed significantly on the pleasant-unpleasant continuum. "Diffi- 
cult Students" started and ended up as the most unpleasant of all 
concepts. The greatest absolute difference betvjeen scores on the 
initial and final administration was for "Science Instruments and 
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ft then for "Process -Centered Activites." "Process-Centered 

^ewed by the participants as ' 

mo«it dull, rather unimportant and unpleasant, became, after the s 

SSK? ?«« *“« «■' 

pleasant concept of the ten. 

The ratings on the scale of hard-easy are interesting. This was 
the most unfavorable of all dimensions. On this scale, fow of the 1 
nork+c? wore origi nal ly on the unfavorable half of the scale; even 
S the iSti^^^ "Difficult Students" and "Disadvantaged Chil^en" 
alter . 4 „xj_«+ 4 veiv "hard." All mean differences in score, vdth the 

e^eption of "Teaching Skills and Techniques" and "% El^entary School" 
were^statistically significant. The largest absolute ^fference was 
ir"SciScrinstmnenL and Materials" and "Individualized Science 

As a matter of fact, by the end of 
oartioipants felt that Idle "Science Instruments and Material., had 
tecome the "easiest" of ai«r of the concepts measured. 



are sS?ised in®T^le 32isle°pa|r7l"! m of theL sc^es ^e more 
of the hard-easy dimension. 

Act ran be seen in Table 32, all changes in mean score on the 
dimention of order-chaos were significant, including "I^ El^^ta^ 
<^ohool" and "(Difficult) Students." "Scientific Investigations y 
wS" Sd "Kf ts a Science Teacher" became most ordered, while 
SficSf indents," "% Elementary School" "Disadv^taged^^ 
Children" had the least absolute change. Comparatively, ^ , 

Institute! "Scientific Knowledge" and Teaching Skills and 

Techniques" were most well-ordered. 

As can be hypothesized, "'Difficult' Students," 

Students"“nd "Scientific Investigations by Pupils" started out a^ 
SSCC asf i^!y unpredictable (although they all 

refsrconcCptfafcompCrCd to the two previously described as most- 
personal-related concepts • 

standable to the teacher-participants. The change i Ay 
School" was not significant. 

On the scale of conrolicated-simple there was no statistically 
sianiScC^? !Sf? for "^ientific Knowledge," ''K/self as a Science 
TtlCher " "My Tewhing Skills and Techniques" (this concept te^d 
to tecSle more unfavorable, i.e., more complicated), "Hy 
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Blementary School" and "Difficult Students." The greatest absolute 
7^S^Sficant) change .las in "Instruments and Materials" which was 
rSed as much more simple on the second administration. This dtoension, 
coi^licated-strange, produced the most unfavorable ratings of all the 
Understandability scales. 

1-ith the exception again of "Ify Elementary School" and "'Difficult' 
Students", all mean differences in scores between adirdnistraUons were 
highly significant on the dimension of familiar -strange. 

exoected. there was little absolute change in the concept of 

"DisadvanSged Children." Great amounts ,t 

for "Korself as a Science Teacher," "Scienti&c Investigatio y P > 

rad "Process-Centered Activities," all ’becoming more f^Uar to the 
^tiSprats. By the end of the Institute "'Difficult' Students" still 

tended to be somewhat "strange,” 

In summary, there were greater absolute changes in concepts on ^e 
Understandability factor as compared with the Evaluative fac tor, ^ Ic 
In this case seems to tap more of the socially acceptable feelings an 
beliefs than does the Understandability factor. 
the scales oos5>rising the Evaluative factor with the 

hard-easy dimension, were more favorable than scores ' 

ability scale. (Post hoc there seems to be some 
believine that the hard-easy scale would be more heavily loaded on 
Understandability; no factor analysis of results has been atterp e , 

SO for our purpose the question of loading is academic./ 

Putting aside the question of cono^t, i.e. 
concepts, the following order reflects the ranldng „„ 

ableness of the scales themselves: lirportance, val^ble, interesting, 

SeSrat, Understandable, ordered, familiar, 

easy. However, there seems to be a negative relationship b . j 
initial rating and absolute amount of change; «iere was most chrage in 
the familiar dimension, followed by ordered, understandable, ^s^ 
valuable and pleasant, predictable, interesting, = W ^ SffS' 
This may be a result of scale oonstruoUon where it is more (ttffi 
to effect change at the ends of the scale (®f 

end, or the end reflecting the desired goal.) This applies equally 
well to the individual concepts. 

As for the concepts themselves, irrespective of , 

the largest absolute change was in "Instruments and Matori^s, _ 
by "Process-Centered Activities," "Myself as a S^^oe ^®®°^ . . „ 

"Individualized Science Activities," "Teaching 

"Scientific Knowledge," "Disadvantaged Children, Difficult Studen 
and "My Elementary School." 

"My Elementary School," included primarily to P™'^'*®, ® 
base, actually changed very little; it did become more valuable d 

somewhat more ordered and predictable. 

The oersonal concepts, "Itself as a Science Teacher" and 
Teaching Skills and Techniques" are interesting. In the former concep 
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were the greatest change in feelings of worth and familiarity. Large 
amounts of change were also apparent in interest, importance and order; 
lesser changes were in pleasantness, under standability, easiness and 
predictability. There was no change in complexity. In Teaching 
Skills and Techniques" there were large increases in value and interest, 
and lesser increases in inportance, pleasantness, order, predictability, 
understandability and familiailty. Small changes occurred in easiness 
and a nonsignificant "unfavorable" change toward conplexity. 

There were two ccucepts considered almost irrelevant to the under- 
lying philosophy of ths Institute: "Disadvantaged Children" and "’Dif- 

ficult* Students." However, "Disadvantaged Children" did become easier, 
more ordered, predictable, understandable, simple and familiar. Par- 
ticipants did not change their ratings of value, interest, importance and 
pleasantness. The concept of "’Difficult’ Students" did become of more 
value, became more pleasant, easier, ordered, predictable and understand- 
able, but not more familiar, more sin5)le, more interesting nor more im- 
portant. In other words these two concepts agreed on the dimensions of 
ease, order, predictableness and understandability. 

The concept of "Scientific Knowledge" changed along all dimensions, 
except complexity; the greatest absolute change was an increased fam- 
iliarity with this concept. 

The concept of "Scientific Investigations by Pi^ils" changed sig- 
nificantly on each scale. The greatest absolute changes were in in- 
creased order and familiarity. 

"Process-Centered Activities" was also significantly more favor- 
ably rated on each scale by the end of the Institute. The greatest 
absolute change was along the dimension of familiarity, pleasantness and 
ease. 



The concept of "Individualized Science Activities" also changed 
significantly on each scale used. The largest change again was in 
familiarity, ease, understandability and sin^licity. 

In general we can feel quite confident that at least along the 
dimensions we selected and the concepts chosen to be rated, the teacher- 
participants did experience a "change of heart" dui*ing the course of the 
six-week Summer Institute. 

Ifl/hether this "change of heart" is tejrporary or permanent, whether 
it can be directly attributable to any one factor of the entire curriculum, 
and whether it will be transferred to actual performance in the class - 
roan are all questions beyond the scope of this report. That is, we 
are not saying that these questions are of secondary importance; on the 
contrary — we believe that any investigations of change in teachers is 
relatively meaningless unless it can be also demonstrated that these 
changes in teachers’ performance, attitudes and/or knowledge will reach 
the pupil and be reflected in pupil achievement. The ultimate success 
of ai^r educational program, whether directed toward parents, teachers 
or children themselves, must be measurable in terms of the improved 
achievement of students. 




RESULTS OF THE TEACHERJPARTICIPANT RATINGS 
OF THE EFFECTIVENESS OF THE NDEA INSTITUTE 
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Ife to this point we were interested in the effects of the Institute 
on the participant; we are now interested in securing information 
about the success of the Institute from the viewpoint of the teacher- 
participants themselves. In defining success we used the criterion 
of how well, how effectively, the objectives of the Institute were 
fulfilled. A statement of objectives had been prepared by the Directors 
prior to the Institute; these stated goals, expanded and made more 
specific, provided the basis for Part I of the Teache r-Par ticipant^ 
Evaluation of the Effectiveness of the Institute . 

Thirty-five statements based on the objectives were developed; 
these included along with some of the goals, some of the methods and 
procedures emphasized in the Institute. Each of the statemen s was 
to be rated in terms of the degree of effectiveness the I^ti\»ute 
demonstrated in meeting the objectives. A four-point rating scrie 
was designed: (l) The Institute has had a NEGATIVE EFFECT on, (2) 

The Institute has had NO EFFECT on, (3) The Institute has ^d 
POSITIVE EFFECT on, and (h) The Institute has had OUTSTANDING PuSITIVB 

EFFECT on 



e • • e 



Part II of the Instrument consisted of open-ended questions 
about the future of the Institute, the areas or problems the participants 
received most-least help with, and suggestions for the in?)rovement 
of this type of Institute program. A copy of the Evaluation of the 
Ef f ec tlvene 55 l 5 appended. (See Appendix G. ) 



Part I: E ffectiveness of the Objectives of the Institutei 
- Participants were asked, at the end of the Institute, to complete 
both parts, the ratings and the open-ended questions. Results were 
obtained for a total of 220 persons. The data were analyzed separate- 
ly for each group as well as for all groups combined. A me^ score 
was computed for each of the 35 s‘t«atments for each of the 15 super- 
visory groups. Rank orders were computed based on these mean scores. 



Table 33 summerizes the mean scores for each item for all groups 
and for the total group combined. For the total group, the average 
score fell between a high o£ 3. hh (between some positive and out- 
standing positive effect) to s- low 2.68 (somewhat between neutral 
and some positive effect); the median score for the total group of 
220 teach-participants was 3.01. For the entire group the highest 
ranking item was their "enjoyment of science"; the least effectively 
realized goal was a change in "ability to scan science trade books 
for appropriate and pertinent concepts." 



Group 06 had the highest mean, 3.87, on any one of the items; 
they were followed by group 10 (3.83), group 03 (3.80), ^roup 07 (3. 9), 
group 09 (3.67), group 08 (3.6li), group 02 (3.60), group 05 (3.59), 
groim Ih (3.53), groups Oli and l5 (3.i*7), group 01 (3.37), group 11 
(3.28), group 12 ( 3 . 25 ) snd group 13 (3.08}. The highest ranke 
item for the different groiqps was rated as having been somewhat more 
than positively effected. The lowest ranking item fell between a mean 
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score of 2.17 (group 33) and 2.83 (group 10). It is clearly apparent 
that there were differences between groups, that certain groups rated 
all objectives (even the least effectively rated ones) as more success- 
fully realized than other groups. The median of the average scores 
reflect group differences; group 03 had the highest median score of 
3,30. followed by group 07 with a median score of 3»25 and group 02 
with a median score of 3.20. Next in descending order ^re 6 ^ 1 ^ 10 
f3.17), group 06 (3.13), group lit ( 3.07), grot?5s 01* and 05 (3.06), 
^oi¥)s 08, 15 and 09 (3.00), group 01 (2.95), groi?) 11 (2.86), group 
12 (2,81) and group 13 (2.^8). 



Table 3h presents the rank order of each item determined separately 
for each group and for the groups combined, A rank of 1 refers to the 
highest mean, 35 to the lowest mean score. Immediately apparent are 
the differences between groups; what one group rated as among the 10 
most effectively realized objectives was not necessarily what other 
groups indicated, although there is a surprising aomount of concurrence. 



Consider the 10 highest rankOorder items obtained for the com- 
bined groups. "Enjoyment of Science" was the highest ranking 
and all 15 of the groups ranked this within the top ten, "Knowledge 
of the earth and its relation to the sun" (item #6), was rated second, 
and all groups with the exception- of 06 ranked this one among the top 
ten. Item 3^» "ease and confidence with materials and ideas in teach- 
ing science to pupils'.', was rated third most successful and I 4 of the 
groups listed it among the top ten. The fourth highest ranking item 
was #17, "ability to plan single experiences to teach science concepts 
to pupils, " ranLd among the top ten for all groups but two. "Famil- 
iarity with available science materials, methods, procedures, and 
sources of information," item 7, ranked fifth highest — all groups 
placed it among the top ten, with the exception of group 06 which 
ranked it in the bottom third. The next five items were items #25, 

1 li, 3 and 5 - "ability to increase the opportunities for pupils to 
collect data and make observations," "knowledge of the growth of a^mals 
and plants," "knowledge of motion and its relation to frames of ref- 
erence," and "knowledge of temperature and thermometers," respectively. 
Four of the groups did not rank item #25 among the top ten, seven 
groups did not rank item #1 among the top ten, five did not rank item 
#3 within the first ten and nine groups did not rate item #5 as being 
among the ten most effectively reached goals. 



It is interesting that again almost all the items dealing 
with change in actual scientific subject matter were among the 
most effectively realized. 

The ten least successful items (based on total group scores) 
were items # 11*, 31, 32, 15 and 33, 13, 30, 18, 2, 21, 26 ^ 2U. 

These items were, respectively, "ability to examine trade books, 
"ability to conduct summarizations that raise new, but rela^d ques- 
tions," "ability to conduct summarizations that answer original 
tions," "ability to write explanations of science concepts" and ' skill 
in evaluating the extent to which pupils have mastered a concept, 
"ability to scan science trade books," "skill in leading and conducting 
discussions of the findings," " skill in designing, constructing and/or 
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Table 3h ^ 

Rank Order of Each of the 35 Statements 

i?.«v. +vie Stm«rviaorv GroUDS (1 « hipest ranK, J-a 



*TTT5i6wledge of growth of ad-mis & plants 

2. KnoTjledge of heat & effects on phases of mattar 

3. Kho^'lsdge of motion 6 relation to fraroas of reference 
J4.9 RnoxjXodge of adap’tiv6 rosponsGS of plcnts & aniioals 

Inoxfledge of temp. & thermometers 

6 . KhoTfledRe of earth & relation to sun 

7. Familiarity idLth available materials, i^thods. .sources 

8. Ability to distingui&h. .variety of teaching approaches 

9. Ability to evaluate teaching experiences to demon- 
strate a concept 

10. Ability to select experience so pupils achieve concept 
n. *' to exploit materials for presorting to pupils 

12. ” to use home. .experiences to develop concepts 

13* » to scan trade books.. for concepts 

•• 111, H to examine & abstract trade books 

Ip. " to Tfrite explanations of concepts 

16. " to coordinate textual & lab experiences 

17. » to plan simple experiences to te^ch concepts 

18. Skill in designing. . .materials 

\ 19. in using models to explain 

' 20. ” " " instruments & materials 

21. Ability to direct «'?t focus on problem 

22. " in laaldng aim clear 

23. » to plan St organi256 individual.. .observation 

\ 2S. Skill in leading individual observation. . . 

25. Ability to inc. pupils opportunity to collect data 

06, v<=!kill in raising pertinent questions 

'57. Ability to encourage pert, quest, from pupils 

28. ’• to exploit pupils* findings... 

29. ” to. ..interpret sin?)le data. 

30. Skill in leading discussions about findings 

31* Ability to conduct summarizations of original Q*s 
32. " ” ' " that raise new Q*s 

33* Skill in evaluating pupils* mastery 
3b. Enjo^nent of science 
35* Csse and confidence 
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"knowledge of heat and its effects npon 
Ktt^ " "Snty to dirfot and focus attention on the 
^bleneing “nsSered" a^r^sldll in leading individual an^or 

Ibservations and discussions." ^^ese ite|® seem to d^l 
Sh fS?lJ abstract classroom techniques for 

Jdth toe pLticipants growth as scientists (as opposed to elementary 
teachers of science • ) 

3St‘ M i2.f.S.S2“ SS.*S<S S ETAi IS. #15 

Sf “aiVX, S'Sr;# ES r..y. «... it- Xi 

ten most successfully met goals. One-third of ^*e groip 

itPtn was included in the least effective. Five groups did not 

rated item #13 among the most effective. One of the fow groups 
which did not rank item #18 as ineffective Placed it th 

most effective items. On items #2 and #21, eight groups did ** 

tKSsritoms were least effective. Sisc groups did not 
K ^ the low ranking for item #26 (two groups this 

Xng the top ten) and 10 groups did not place item #2U at toe bottom 

of the list. 

It would seem that there is most agreement for those items at 
toe e^r^^S especially toe successful ^d and that as one qpproaches 
the xidd-point the number of groups agreeing lessens. 



Part II. Modifications of the Institute ; 

“ ■■ t>art II, “^e open-ended section of the ® 

found in Appendix 0. The first question in tWs part . 

feaoher-Partioipants Eva luation of the Effec ti veness of the Ins — — 
;<Ac ..t.ihgrt ~ an imaeined" iituation in which the participants, >“°^g 
So^lw," were to respond to the continuance, 
uance o/ modification of toe Institute. A count ^ 

of teacher-partioipants in each groi?) *Res2onles 

concerning toe (hypothetical) future of the institute. Response 

were obtained for all 220 persons. 

Table 35 below presents the percentage of participants to ^ch 
groip checking future Continuance, Disoonttouanoe, or Modification 
of the Institute. 
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Almost all of the participants (about 99 per cent) ^ere in favor 
of retaining the same general type of Institute for a futoe group of 
teachers similar to themselves; of the 217 ’’continued and modi^ed 
responses, one hundred forty-four of them indicated that the Institute 
should “be modifiedj 7h persons checked ’’continued," but without 
exception all of these subsequently suggested some form of modifica- 
tion. Only three persons were of the opinion that the Institute should 
be discontinued. Although in general, almost two-thirds of th® total 
participants indicated that the Institute was in need of modificatio , 
there were two groups in which more than half the participan s wan e 
to continue the Institute, and one group where all participants were 
in favor of some form of modification. 

A content analysis was made of the explanations and reasons for 
the selections of the three groups of participants; results of this 
analysis are available by supervisory groups but will not be presented 
here. Only combined groups scores follow. Each stetement made was 
broken down into its different consonants and a talley made of these 
responses. 

Table 36 summarizes, by content category, the number and 
percentage of explanations given by the total of 73 
favored Continuation of the Institute. There was a total of 125 
statements made, an average of 1.7 comments per respondent. (However, 
there were large differences between groups in the average nmber of 
comments per group; for exanple, the participants in group 13 
averaged h*0 statements while the participants in group Oq averaged 
a low of 0.7^ comments.) As can be seen in Table 36, 90 or J2 per 
cent of the 125 comments are favorable and coirpliiS^ntary (noted in 
the table by an asterisk. ) These comments concerned the effectiveness 
of the Institute in increasing participants’ knomedge aM understanding 
(approximately 23 per cent of the total comments), improving partici- 
pants* attitudes, interest and confidence in science and science teach- 
ing (about 12 per cent), improving teaching skills and techniques 
(about 6 per cent). More than 10 per cent of the responses conceded 
the planning which was described as "well-planned," "almost perfect. 

On the other hand, almost five per cent of the tctal number of responses 
indicated that the participants felt that the Ir.st.itute was in need 
of better organization and structure. The remainder of the comments 
oil concerned specific modifications: better, more simp3.ified and 
more sophisticated audio-visual materials (U per cent), more depth 
and variety in materials and information (2.ii per cent), and a better 
library and more textbook assignments (2. it per cent). 

Some group differences, not included in Table 36, will be described; 

In general, the comments of groups 10, 02, 03 and 09 were ^ost invariably 
favorable; groups 01, 07 and 09 were divided, while group for ^an^le, 
is most unfavorable suggesting the greatest percentage of modifications. 
Groups 0U,05,nA2, Ih and 15 tend to be more favorable ^an not, suggest- 
ing modifications that account for roughly one-third of their total 

comments. 







Table 36 



Number and Percentage of Modifications Suggested by the 
73 Participants ^;jho Favored Continuation of the Institute 



N Per Cent 

It ems Comments Total Comments 



1. Increased knowledge, understanding, philosophy • 

of science 29* 23 • 2/^ 

2. Improved skills, techniques 8* 6.U 

3. Change grouping; group homogeneously by background 1 0.8 

U. Improve quality of instructors 2 1.6 

$0 The materials were new and good U* 3«2 

6. The experts, outside speaker, lecturers (specified) 

were valuable 3»2 

7* Increased awareness of variety of resources 7* ^.60 

8. Increased awareness of importance of pupil partici- 

pation 2*” 1.60 

9. It was a stimulating experience U*0 

10. Inproved self-confidence, attitude and interest 12.0 

11. It was well-planned; good, almost perfect 13-^ 10. U 

12. Needs more structure, tighter organization 6 i^.8 

13. Needs more relatedness to pupils, to the classroom 1 0.8 

lU. Needs better lectures and lecturers h 3*2 

15. Needs better field trips 2 1.6 

16 • The finances were excellent 1* 0.8 

17. Needs more group interaction 1 0.8 

18. Needs better tapes 5 U.O 

19. Needs smaller size groups 1 0.8 

20. Goals should be defined 1 0.8 

21. Needs a better library, more textbooks 3 2.1* 

22. Needs improved methods of self-evaluation 1 0.8 

23. Content was too difficult; sin?)lify content 1 0.8 

2i*. Needs more depth, more information 3 2.1* 

2$. The working with children was good 1* 0.8 

26. Instructors were excellent 1* 0.8 

27. Eliminate individual projects 1 0.8 

28. Bfiprove the ways of working with children 1 

total (73 Continuation Respondents^ l25 100.0% 



Note: * Indicates favorable statements made by the participants 
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As can be seen in Table 36, 90 or 72 per cent of the 125 comments 
are favorable and complimentary (noted in the table by an asterisk.} 

These comments concerned the effectiveness of '^e Institute in increas- 
ing narticipants * knowledge and understanding (approximately 23 per 
cent of the total comments), Improving participants* attitudes, interes 
and confidence in science and science teaching (about 12 per cent}, im- 
proving teaching skills and techniques (about 6 per cent), and i^^creas- 
Ing participants' awareness of the variety and sources of materials 
per cent) . More than 10 per cent of the responses concerned the pla- 
ning which was described as "well-planned,” "almost perfect. On the 
other hand, almost five per cent of the total number of responses in- 
dicated that the participants felt that the Institute was in need of 
better organization and structiire. The remainder of the comments all 
concerned specific modifications; better, more sijrplified and more 
relevant lectures (3.2 per cent), proved and more sophisticated 
audio-visual materials (U per cent), more depth and variety in materials 
and information (2 .It per cent), and a better library and more textbook 
assignments per cent). 

Some group differences, not included in Table 36, will be described; 
In general, the comments of groups 10, 02, 09 were almost invar- 

iably favorable; gro\ips 01, 07 and 08 were divided, while group 13, £ 
exaitrole, is most unfavorable suggesting the greatest percentage of mod- 
if^tions. Groups Oh, 05, 11, 12, Ik and l5 to be more ^avor^le 
than not, suggesting modifications that account for roughly one-third 
of their total comments. 

Only three persons voted having the Institute Discontinued. They 
averaged about three comments each, complaining of poor organization, ^ 
inadequacy of materials and equipment, poor quality of supervisors and 
the overly large size of the groups. 

As previously indicated, (see Table_35), two-thirds of the teacher- 
participants were in favor of future modifications of the Institute. 

This group of lUlt persons made a total of 373 comments, an average of 
2.59 - more responses per respondent than obtained for the Continuance 
croup. There was a difference between groups in average number of 
responses, from 2.00 for group 03 to 3.78 responses for group 11. Table 
37 summarizes the kinds, numbers and percentages of responses for the 
total group in favor of modification of the Institute. Breakdowns for 
each of the l5 supervisory groups are available but will not be pre- 
sented. 



For the total group favoring modification the most frequently ^n- 
tioned need for change was in the kinescope tapes; about 10 per cent 
of their responses were concerned with iitproving the content or doing 
away with the tapes altogether. More than seven per cent 
sponses indicated that the science information was too , 

an additional seven per cent felt that the lectures could be simplified 
end the lecturers more carefully selected. 

Another seven per cent of the comments were directed toward general 
modification of the organization, planning and structure of the tostitute 
more specifically, 3.5 per cent of the comments were concerned with the 
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physical facilities, another 1.6 per cent with the need for a college 
setting (library, etc.), cent with the large size of the indi- 

yidiial groups, 2.7 and 2,h per cent with the selection of the 
pants £d the supervisors respectively. Another 3.5 per cent indicated 
that the alms and goals of the program should be defined and adhered to. 

In general, for every content category the opposite was also included: 

For example, almost three per cent of the responses suggested less 
stress on theory and more on techniques and methods, while another three 
per cent of the comments were directed toward less methodology and more 
eirohasis on theory. About two per cent of the responses favored an im- 
provement in supervisory personnel while an almost equal percentage felt 
the supervisors were good and should be permitted more flexibility and 
freedom. However, it should be noted that the groins' patterns of re- 
sponses differ. The groups may be characterj.zed as follows: in group 
01 the concern was primarily with administrative stinjcture, organization 
and top-level personnel; grot^ 02 was primarily concerned with the 
Institute's relevancy to the actual elementary level classroom (specif- 
ically noting that there should be more lesson planning and more appro- 
priate and sinple lectures); group 03 also suggested an increased em- 
phasis on methodology and technique, indicating that the technical aspects 
were too difficult; group Oh indicated a need for stress on the school- 
room and the child; group 0$ was concerned with the poor phys5.cal facii-- 
ities of the plant and the inadequate viewing conditions of "kinn^ 
and lecturers. In addition, this group indicated inadequate supervision. 
On the other hand, group 06 indicated that their supervisor was excellent 
and there should be more theory and more individualized exper j.encevS » 

Groups 07, 08 and 09 were concerned xd.th the large size of the groups, 
the kinerescopes and respectively, the experience with 
physical plant and the undue amount of theorizirtg; group 10 felt t*iat 
the prograiTi, notably the lectures, were too technical; group 11 
pla.Vr.-.d of toasted time and poor supervision; group 12 felt that the 
CUT 3 Ic^^Lum was too broad and the lectures - too technical to begin 
with — were unrelated to the actual functioning of a classroom; group 
13 was also concerned with structure and organization and was di^ded 
on the thecr^Y vso methodology issue; group Ih felt that the material 
was too tp;.."ivjical and should have more relevancy to the classroom; group 
1$ was 3 ir;o .! ar tu- group lii but in addition was very ccncemed with tne 
quallT-y of the IdxUiescopss. 

The next question in Part II asked the participants to Hst the 
specific areas, problems, and objectives that they received (1) most 
help in, and (2) least help in. The content analysis is summarized in 
Table 38. Results for the individual super/isory groups were a^lyzed, 
but only the combined total is presented in the table; group differences 
will, however, be described. 

As can be seen in Table 38, about 61 per cent of the total number 
of lOh tallied respcn»^es were concerned with areas that participants 
received most help in. For each of the supervisory groups the number 
of most-help responses was greater than the least -help responses aver- 
aged 1.71 for grou^. 11 to 0.60 for group 03. Clearly, in terms of 
quantity of respr /'.aes, the groups wore more verbal in describing the 
assets of the I^;Stitute. 
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Table 37 

Number and Percentage of Modifications Suggested by the lUl| 
Participants l/^o Favored Modification of the Institute 



Item 

X. «j-jauinate the working with children 

2. Need more individual and individualized experience 

3, Inprove, and increase the laboratory sessions 
1^. Simplify lectures and improve quality of lecturers 

5. Better selection of instructors 

6. The directors were inadequate 

7. Too much time was wasted 

8. Physical facilities were poor, need inprovement 

9. Change environment, provide college setting 

and library 

10. The information presented was too elementary, 

too little 

11, Include send.riars, discussions and follow-ups 

12, Need more field trips 

13. Provide some choice in activities 
lU. Improve organization and structure 

15 . Need less theory, more methods and techniques 

16. Tapes wore inadequate; improve or delete 

17. 0rgara.z3 omaller groups 

18. Spend more time on lesson planning 

19. Assign more readings and homework 

20. Need more audio-visual material 

21. Need r«.r*e eirphasis on early childhood 

22. selection of participants 

23. Have m-re materials and more easily available 
2U. Curriculum was too broad 
25* Too technical 

26. More I'c'lation to schools and children 

27. Ifcke ,?x'cups homogeneous 

28. Define alms, goals of Institute and roles of ; 

participants 

29* ihnprove work with children 

30. More emphasis on the disadvantaged 

31. More theory needed, less methodology 

32. Lectures were adequate 

33. Need more specialists, experts 
Need more direction, supervision 

35. Instructors need more freedom : 

36. Need more interaction between groups 

37. Teachers should be involved in planning 

38. Less time devoted to outside assignments 

39. More emphasis on the physical sciences 
UO. Classroom methods were good 
1*1. Need more demonstration lessons 
1*2. Materials should be graded 
1*3. The materials and ideas presented were good 
1*1*. Deemphasize the disadvantaged 
1 * 5 * The objectives were not 'jarried out well 

Total (11*1* Modification respondents) . 

Note; * indicates favorable statements made* by the participants 



ments 


Total ConmentB 




1735 


13. 

9 


3.U8 

2M 


27 


7.2U 


9 


2.1(1 


7 


1.88 


7 


1.88 


13 


3.1*8 


6 


1.61 


11 


2.95 


5 


1.31* 


11 


2.95 


3 


0.80 


26 


6,97 


10 


2,69 


39 


10.1*6 


13 


3.1*8 


1* 


1.07 


5 


1.31* 


2 


C.5I* 


h 


1.07 


10 


2.69 


8 


2.11* 


3 


0.80 


28 


7.51 


22 


5.90 


1 


0.27 


13 


3.U8 


9 


2.1a 


k 


1.07 


10 


2.69 


1* 


0.27 


h 


1.07 


1 


0.27 


8 


2.11* 


1; 


1.07 


1 


0.27 


1 


0.27 


1 


0.27 


1* 


0.27 


6 


1.61 


1. 


0.27 


3* 


0.80 


1 


0.27 


3 


0.80 


373 


100.0^ 
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Forty-one per cent of the total (most-help plus least-help) responses 
were concerned with subject matter. The most frequently mentioned area 
was the physical sciences, followed by earth science and biological 
science. However, the physical sciences were most often described as 
being least helpful, (Seventy-two per cent of the physical science re- 
sponses were of least-help type as compared with nine per cent of the 
earth science and 21 per cent of the biological science responses, 2 

For the total group of participants the areas mentioned most fre- 
quently included - in descending frequency - information, knowledge and 
understanding (61 per cent of these responses were ’’helpful") s the 
techniques and skills necessary for planning and conducting actual class- 
room lessons (8^ per cent of the responses were ’’unhelpful’’): the use of 
materials and equipment (more than 80 per cent were most helpful); re- 
sources and sources of available materials and information appropriate 
to New York City classrooms (half of the group said most-helpful and 
half said least-helpful); philosophy of science as related to individ- 
ualized instruction and independent pi:?5il discovery (82 per cent of 
these responses were of the most-help in type); a change in interest in, 
confidence with and attitude toward science (89 per cent received most- 
help in); understanding disadvantaged children (almost half and half); 
the role of the supervisors in providing guidance and follow-up (about 
70 per cent of the responses indicated that supervisors provided very 
little help). Very few comments concerned other areas that the Institute 
was to be involved with; for example, organizing and interpreting data, 
evaluating pupils' performance and understanding, methods of self-eval- 
uation, learning a variety of experiences and approaches, and the kin- 
nescopes. 

As anticipated, there were wide differences between groups; group 
01 indicated a great deal of help in the knowledge provided, especially 
in biological and earth science, and some little help in lesson planning 
and the physical sciences; group 02 also felt that earth science was 
helpful and physical science not helpful. In addition, group 02 was 
well satisfied with the materials and equipment and the techniques and 
methods for using them. Group 03 indicated that they received a good 
deal of help with materials and equipment that could be related to the 
classroom, and in general felt the Institute was extremely worth-while; 
group Ok appeared satisfied in general with the knowledges and under- 
standings gained but not with the methods, techniques and skills necesi^ 
sary for implementation. Group 05 was impressed with the biological 
and earth sciences, but definitely not with the physical sciences. 

Group 06 indicated help in knowledge and information, especially as pro- 
vided by their supervisor, but received little help in learning to pre- 
pare lessons which would lead to pupil discovery. Group 07, on the 
other hand, indicated much help idth learning to lead pupil discovery and 
learning a variety of experiences applicable to the New York City class- 
room; group 08 received help in earth science but felt that they received 
little help from the supervisor. Group 09 indicated no help in physical 
science and much help in earth science. They felt that there was too 
little Information provided and too little direction in Indicated sources 
and resources for filling this gap. Group 10 received help in methods 
of presentation and knowledge , esj^eclally knowledge related to earth and 
biological sciences. Group 11 was primarily inpressed with positively 
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Table 38 

Nuuiber aiid Percentage of Comments Describing Those Areas of the Institute 
the Participants Pound Host Helpful, Least Helpful 





"■ !l 


N 




Per Cent 




Most 


Least 


Total 


of 


Item 


Help 


Help 


Comments 


Total 


!• individual projecis, papers, assignments 


5 


k 


12 


IT75 


2. Using materials, equipment 


29 


7 


36 


5.:j. 


3* Knowledge and understanding about science 
h. Interest in, confidence with, attitude 


36 


23 


59 


8.38 


toward teaching science 


2h 


3 


27 


3.81* 


Lesson and program planning 


9 


50 


59 


8.38 


6. Ideas and materials for the classroom 

7. Understanding Children, especially the 


16 


1 


17 

2h 


2.1*1 

3.ia 


disadvantaged 


11 


13 


8. Irrprovlng own (self) resources 


6 


— 


6 


0.81* 


, 9. Lectures and lecturers 


2 


8 


10 


i.ia 


10, Field trips and observations 

11. Kinnescopes and other audio -visiial 


3 


-- 


3 


0.1*2 


materials 


1 


3 


h 


0.57 


12. Interpretation of data, findings 


1 


1 


2 


0.28 


13* Sources of materials and information 


lii 


lU 


28 


3.98 


lU. Tesctbooks and readings 


h 


2 


6 


0.81* 


1$, Defining science teachers' aims and goals 


2 


1 


3 


0.1*2 


16. Learning a variety of experiences 


5 


— 


‘5 


0.71 


17. Science and everyday phenomena 


2 


mmmm 


2 


0.28 


18. Exchanges between participants 


2 


m» mm 


2 


0.28 


19. Supervision and follow-up by supervisors 


5 


11 


16 


2.27 


20. Laboratory experiences 


8 


2 


10 


1.1*1 


21. Demonstration lessons 


1 


— 


1 


O.ll* 


22. Methods, classroom presentations 


20 


6 


26 


3.69 


23. Philosophy of pupil discovery 


23 


5 


28 


3.98 


2h. Self-evaluation 


2 


— 


2 


0.28 


2$, Mathematics and Science 


1 


-- 


1 


0.11* 


26. No help at all provided 


- 


h 


h 


0.57 


27. Everything provided was helpful 


9 


— 


9 


1.26 


28. Biological Science 


67 


18 


85 


12.07 


29. Earth Science 


87 


9 


96 


13.63 


30. Physical Science 


30 


78 


108 


15.31* 


31. Organizing data and findings 


— 


1 


1 


O.ll* 


32. Evaluating pupil understanding 


— 


2 


2 


0.28 


33. Experiences (Institute) with children 


— 


6 


6 


0.81* 


3k. Physical facilities 


-- 


3 


3 


0.1*2 


35. Trade Books 


1 


— 


1 


0.11* 


Sub-Total: biological, earth and physical 


• 








science 


181* 


105 


281* 


la. 01 *;$ 


Total all items 


1*29 


275 


701* 


100.00^ 
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chsnged a't'tl'budos^ in'fcores'bs and confidances but less "with the aid re- 
ceived in the areas of lesson planning. Group 12 received some help in 
all informational areas, as revealed by the frequency of response, but 
as a group were divided on the other questions. Group 13 was the only 
group where the least-help category equaled in frequency the most-help 
category; they indicated help in individual activities, field trips 
and readings, and least help with increased understanding and ability 
to plan a lesson. Group Ih found biology and earth science helpful, 
but not physical science; they were least pleased with the areas of the 
disadvantaged and with all lectures. Group 1^ found the Institute help- 
ful in most areas with the exception of the physical sciences. 

In summary, despite individual group differences the participants 
generally found the Summer Institute helpful and said so in both the 
quantity and quality of responses. As a group they ind>.cated that they 
received most help in earth science, biological science, general kniiwl- 
edge and understanding, positively changed attitudes, xisthods, techtiiques, 
equipment and materials. They indicated, as a group, that they received 
less help in the physical sciences, with lesson planning, with sources 
of materials and xd.th the disadvantaged. 

The final question in part II of the Teacher -Particdpant Evaluation^ 
of the Effoctive^ iess of the Institute asked the parti clpantc*. to suggest 
inpro'yfaments for this type of Institute program. A total of 299 sugges- 
tions were ma^or an average of 2.2? suggestions per participant. Groins 
differed in average number of suggestions made; group 11 averaged 4o07 
suggestions while group 13 averaged only 1.25 suggestions. The number 
aytd percentage of each type suggestion is summarized in Table 39 for 
the total groi:p. 

The two pingle most frequently mentioned suggestions concerned 
(l) improving the lectures and lecturers and (2) improving the kinne- 
scopes. The participants suggested that the lectures shoiild be simpli- 
fied (about 8 per cent), the lecturers more carefully selected (about 
k per cent); they suggested that the lecturers should be more interest- 
ing speakers and the lectures should have greater applJ.cability to the 
elementary school classroom. One per cent of the responses, on the 
other hand, indicated satisfaction with the lectures. 

It is difficiilt to evaluate the comments about the kinnescopes 
because the intrinsic value of these films is not readily separable 
from the environment in which they were received. The filming technique 
was somewhat inadequate and the kinnies audio part was almost completely 
lost In the auditorium setting. At any rate, participants suggested 
either inproving the films by using expert teachers, or doing away with 
them entirely, and perhaps, substituting ••real-life” observations of 
classes . 

A large proportion of the suggestions may be described as having 
to do with policy, organization and physical facilities. Almost six 
per cent of the responses were directed to iirproving the organization 
and structural administration of the Institute; another two per cent 
with time scheduling (time not used most productively. ) Four and one- 
half per cent of the suggestions concerned more comfortable physical 
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Table 39 



Number and Percentage of Suggestions for Inprovements 
Made by the Teacher-Participants (Total Group) 



Suggestions 


N 

Comments 


Per Cent 
Total Comments 


!• Jinprovo &dinlnis*birsLt}lon 


and structure 


29 


5.82 


2. Do not waste time 


11 


2.21 


3. Have more books > texts and a better library 


11 


2.21 


a. Have real classes to work with: delete 


settlement house work 


21 


1».27 


5. Improve physical facilities 


22 


u.ia 


6. Increase number of lectures - they were 


good 




1.00 


7. Inprove tapes or substitute live • obser- 


vations 


35 


7.02 


8. Improve quality of supervisors 


21 


U.21 


9. Increase niaiiber of field trips - they 


were valuable 


25 


5.02 


10. Construct mateilals or only provide those 


available to NYC 


5 


1.00 


11. Gear to the disadvantaged 


7 


l,i<0 


12. Need more adequate materijls 


6 


1.2D 


13. The Pla;ietaria’ii was an excellent experrlence 


h 


0.80 


la. Laboratory so'^sions need 'jj,provement or 


do away with 


7 


i.Uo 


15. More follow-up, discussion and siminars 


needed 


8 


1.60 


16. Need an Early Childhood staff 


h 


0.80 


17. Individual projects should be deleted 


h 


0.80 


18. Independent study was wortliwhile 


3 


0.60 


19. Inprove and increase laboratory experiences 


9 


1.80 


20. Inprove the selection of participants 


9 


1.80 


21. Give more responsibility to supervisors 


Ih 


2.81 


22. Inprove quality of lecturers 


22 


2(.t4l 


23. Increase the number of resource experts 


18 


3.61 


2h» Use testing program to diagnose weaknesses 
25. Do away w3.th the salesman and the •' 


9 


1.80 


commerciality 


5 


1.00 


?6. Have more interaction between groups 


13 


2.61 


27. Establish goals, al^s and objectives 


6 


1.20 


28. Too easy, more factual informat:Ir»n is 


needed 


2 


0.1(0 


29. A good general background was provided 


5 


1.00 


30. Some of the materials were good 


9 


1.80 


31. The people were nice, contacts between 


them were good 


2 


o.uo 


32. Lectures were too di.fficult, simplify 


38 


7.62 


33. Curriculum too broad, too much covered 


k 


0.80 


Have smaller groips 


13 


2.61 


35. Have fewer field trips 


2 


O.UO 


36. The techniques taught were good 


h 


0.80 
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Table 39 - cont*d. 



37. The experience improved confidence 

38. Need some exposure to alternate approaches 

39 . Ifore emphasis on methodology, techniques, 

how to teach 

kO, Improve internal communication 
I 4 I. Specific lecturer was good 
U2. Specific lecturers were poor 
U3. Biological science worthwhile 
liU. Less emphasis on methodology 

More relation to classroom and age 
differences 

U 6 . Needs to be more formalized, partici- 
pants need more discipline 
U7. It was inflexible, unprofessional 
U 8 . Experiences for participants should 
be individualized 
U9. The groining was good 

50 . Directors and leadership was good 

51 . Ih^jrove motivation of participants 

52. Inprove field experiences 

53. More enqphasls on earth science 
Reestablished own ideals about teaching 
Everything was good 

56 . Everything was bad 

57. Basic premise was good, implementation 

faulty 

$8. Biological sciences were inadeqtiate 
59. Laboratoiy sessions worthwhile 



1 

3 

8 

2 

3 

1 

1 

1 

13 

6 

3 

9 

3 

h 

1 

9 

3 

1 

1 

6 

1 

1 

1 



U99 



0.20 

0.60 

1.60 

O.UO 

0.60 

0.20 

0.20 

0.20 

2.61 

1.20 

0.60 

1.80 

0.60 

0.80 

0.20 

1.80 

0.60 

0.20 

0.20 

1.20 

0.20 

0.20 

0.20 



100 . 0 ^ 



Total comments 
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facilities (it was an especially hot summer) with special emphasis on 
having a library and a reference collection of books and materials 
available. Several conflicting suggestions were made about the structure * 
direction and commimicative problems involved in a large Institute. 

Almost two per cent of the comments were about the selection of 
participants with the suggestion that they be better selected to assure 
their interest and con^Jetency. Another two per cent wanted tests used 
to diagnose individual weaknesses, in order to group participants accord- 
ing to level of interest and background. Approximately three per cent 
suggested smaller groups and another 2.6 per cent wanted more inter- 
action between groups. A very few responses indicated that the groups 
(size and quality) were adequate, the people nice and the personal con- 
tacts good. 

There were several items about the supervisory and leadership 
aspects of the situation. About five per cent of the comments indicated 
that the expert leadership, noteably* the directors, was good; three per 
cent felt that the supervisors were inadequate, and suggested that in 
the future more attention should be paid to the selection and training 
of supervisors. Two per cent of the total number of responses indicated 
non-professionalism, poor motivation and suggested more formalized 
discipline be required of the participants. 

Suggestions about the content and the curriculum of the Institute 
were made: four per cent of the comments suggested the abolishment of 
the experiences with children; about five per cent indicated that the 
field trips were good and should be increased in number, while another 
two per cent indicated that the field trips were inadequate and should 
be eil 3 .iinated in the future. It was suggested that the individual and 
indepe;ident projects be eliminated - be retained; the laboratory sessions 
were considered valuable (two per cent) - worthless (l.^ per cent). 

There was also conflicting suggestions about materials. 

Slightly more than two per cent of the suggestions were for more 
emphasis on methodology and techniques on how to teach using a variety 
of approaches; another 2.6 per cent of the suggestions concerned re- 
lating the methodology and materials to the situation found in the New 
York City classroom. Some two per cent of the comments suggested less 
of an enphasis on methodology and techniques. 

There was a variety of additional comments and suggestions (see 
Table 39), generally as many for increasing something as for abolishing 
the same thjoag altogether. Most of these apparent contradictions are 
accounted for by the differences between the supervisory groups. For 
example, most of the positive comments about supeivisors were made by 
groups 06, 07 and 1^, while groups 01, Oli and 11 account for most of 
the statements about supervisor inadequacy. 

Again, as noted previously, different ‘groips share different 
concerns: the suggestioiis made by groups 01 and 02 concerned the ad- 
ministrative and organizational aspects of the Institute; for group 03 
the lectures were the source of concern; group 0? was concerned xd.th 
group interaction and group 0 $, for exan 5 >le, was concerned with the 



methods and techniques for science teaching. 

In summary, it is clear that in general the teacher-particip^ts 
felt that the Inti^/itnte had some positive effects, and had been 
tive in realizing most of its objectives. There were, of course, i^i- 
vidual differences as well as group differences - in fact it is possible 
to characterize the groups on the basis of these differences. 

It is our impression that the participants were quite verbal ^d 
outspoken in evaluating the Institute 5 in general they were intelUgent 
and discriminating in their comments and suggestions which covered a 
wide variety of general and specific items. Foremost among 
tages was the increase in knowledge and understanding of the biological, 
physical and earth sciences. This is in accord ^th 
tained on the tests of science information and also substantiates some 
general impressions. Participants also expressed an increased interest 
and confidence with science and science teaching; it is sincerely hoped 
that these effects will be transferred to the pi^ils in their class- 
rooms. 



RESULTS OF THE; SUPERVISOR-PARTICIPANT EVALUATION OF 
THE EFFECTIVENESS OF THE INSTITUTE 

On the last day of the Institute, a rating scale was given to each 
of the 1^ supervisors to complete and return as part of the total eval- 
uation of the Institute. This scale, the Supervisor-P articipant Eval- 
uation o f the Effectiveness of the Institute ^ is parrellel in form ^d 
intent" ■bo' the Teacher-Participant Evaluation of the Effect iveness of the 
Listitute. A copy of this instrument can be found in Appendix H. 

Only seven supervisors, one teacher leader, three assistant prin- 
cipals and three anonymous supervisors, turned in ratings. These will 
be discussed but no attempt will be made to generalize the findings to 
the non-respondents. 

The first section of this scale, which all seven supervisors com- 
pleted, listed 3^ goals and objectives of the Institute. Supervisors 
were asked to rate the effect of the Institute on each separate 6®®"* 
using a four-point scale where 1 ® negative effect, 2 - no effec , 3 ® 
some positive effect and k * outstanding positive effect. The mean 
rating of all supervisors on all 3^ items was 3.18, slightly more than 
’’some over-all positive effect.” 

The average rating for each item and the rank-order position of the 
items are summarized in Table kD» As can be seen, the range in rating 
is from a low of 2.71 (not quite same positive effect) to 3*71 (atoost 
outstanding positive effect.) The lowest item ranking item was "teach- 
ers' ability to wrtfe explanations of science concepts.” The highest 
ranking i'tems “were ^^teachers* enjoj^tnent of science*^ and •^teachars* abll- 
ity to plan sinple experiences to "teach science concepts to pupils." 
Also highly rated was "teachers* knowledge of the growth of animals and 
plants", and "teachers* ease and confidence with materials and ideas in 
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Averagt joore and Rank Order of the 35 Objectives as Rated 
by the Supervisor-Respondents (M = 7») 



Item: Te achers* t - . 

Ability to plan simple experiences to teach 
concepts to pupils 
Enjoyment of science 

Knowledge of the growth of animals & plants 
Knowledge of the adaptive responses of 
plants and animals 

Ease ^nd confidence with materials and ideas 
in teaching science to pupils 
Knowledge of temperature and thermometers 
Ability to distinguish among a variety of 
teaching approaches 

Skill in using models to study and explain 
science phenomena 

Skill in using science instruments and 

materials ^ 

Ability to plan and organize individual and/or 
small group observation of a natural phenomenon 
Knowledge of the earth and its relation to 
the sun 



Mean 

Score 

3.71 

3.71 

3.^7 

3.57 

3.57 

3.U3 

3.U3 

3.U3 

3.U3 

3.U3 

3.28 



Ability to exploit extrant materials for pre- 
senting concepts 

Ability to use home and community experiences 
to develop concepts 

Ability in making the topic or aim of the lesson 
clear 

Skill in leading and conducting discussions 
of the findings 

Knowledge of motion and its relation to 
frniuos of reference 

Familiarity xijith available science materials, 
methods, procedures and sources of info. 

Ability to coordinate the use of textual 

and laboratory materials 

Skill in designing, construction and/or 

assembling simple materials 

Skill in leading individual and/or small 

group observations & discussions of a 

natural phenomenon 

Ability to conduct summarizations that an- 
swer the original questions 
Ability to evaluate teaching experiences to 
determine how well it will demonstrate a 
specific science concept 
Ability to select the appropriate teaching 
experience through which pupils may achieve 
specific science concepts 



3.28 

3.28 

3.28 

3.28 

3.lh 

3.1U 

3.1U 

3.1U 

3.1U 

3 . 1 ^ 



3.00 



3.00 



Rank 

Score 

1.5 

1.5 

U.o 

U.o 

h.o 

8.0 

8.0 

8.0 

8.0 

8.0 

13.0 

13.0 

13.0 
13.0 
13.0 
18.^ 

18.5 
18.^ 
18.5 

18.5 

18.5 

25.0 
25.0 
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Ability to scan trade books for appropriate and 
pertinent concepts 

Ability to direct and focus attention on the 
problem 

Sidll in raising pertinent questions about the 
findings 

Ability to collect, organize and interpret 
cii'iple data 

SLill in evaluating the extent to which pupils 
have nastered a concept 
"■ncxv7.cdge of heat and its effect upon the 
pnases of matter 

Ability to examine trade books for the purpose 
of abstracting the content 
Ability to increase opportunities for pupils 
':o collect data & make observations 
Ability to encourage pertinent questions 
about findings 

Ability to exploit and expand pupils findings, 
exa’nples, and inquiries 

Ability to conduct summarizations that raise 

new, but related questions 

Ability to write explanations of science 

concepts 



3.00 


25.0 


3.00 


25.0 


3.00 


25.0 


3.00 


25.0 


3.00 


25.0 


2.86 


31.5 


2.86 


31.5 


2.86 


31.5 


2.86 


31.5 


2.86 


31.5 


2.86 


31.5 


2.71 


35.0 
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teaching science to pupils.” 



These ratings are very similar to the teachers' rating of 1*e items. 
Teachers' rated as highly effective their enjoyment of science, their 
ease and confidence with materials and ideas, their ability 
pie experiences to teach science concepts. There were some differences; 
for example, supervisors rated teachers* knowledge of “motion and its 
relation to frames of references" fairly low, while the teachers 
this item among the ten most effective. Teachers felt that there had 
been a highly effective change in their "ability to increase op- 
portunities for pupils to collect data and make observations, ^ e 
supervisors rated the Institute as fairly ineffective in effecting 
this kind Of behavior. The rank-order correlation between teachers 
and supervisors rating of the items was .61 - the agreement was mal.nly 
between the most successful items. 



In the second section of the Supervisor-Participant Evaluatip_n,pf 
the Effectiveness of the Institute > supervisors were asked about pos- 
sible ch^ges for future Institutes and about the stren^hs and weak- 
nesses of this experience. 



In general as a group, they did not say much. Fodl* of the seven 
were in favor of the Institute being continued, all Of them Sugpsting 
some form of modification. The remaining three respondents vanted rat- 
ification of the Institute. Tne modifications ihclutd Smaller total 
size and more structured and better planned interaction between groups. 



The strengths of the Institute, those areas that the super^sors 
felt the teacher-participants received most help in were the laboratory 
experiences, planning for a more effective school program, lesson plan- 
ning, the use of the experimental method, knowledges of specific sub- 
ject areas, handling materials and the ability to distinguish betwen 
a variety of teaching approaches. The Institute was least helpful o 
the participants,according to the supervisors in teaching them some 
factual information, in helping them apply the theoretical knowledge 
to classroom situations, providing library facilities and materials 
available to the New York City classroom. 



The supervisors felt that they, as supervisors, were most help- 
ful to their participants in developing attitudes toward teaching 
science, in explaining and clarifying difficult concepts and trans- 
lating them for use in the classroom, in encouraging teachers, and ^ 
analyzing the lessons. They were least helpful to their participants 
in helping them design science exhibits and in utilizing textual mate 
rial. One supervisor noted that only those supervisors that 
good science background were able to effectively help their partici- 
pants and fulfill their primary role of preparation follow-up and re- 
inforcement. 



The following suggestions were made; provide materials available 
to the NYC classroom and allow the participants time to experiment, 
manipulate and create activities for themselves and their pupils. 
Modi^ the lectures; the lectures were "too dry, too technical and 
too long" and there should be more time devoted to si^ervisors for 
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clarifying the lectures. Participants should be made responsible for 
attending the sessions. Supervisors shou?-d have a con?)lete set of ma- 
terials in advance^ a:'’ familiarity idth the oyer-all objectives in 
order to transmit them to their teachers. Major strengths were the 
’•esprit de corps" which developed^ the administraters themselves and 
the materials they provided^ the independent study projects, the de- 
velopment of positive attitudes and the overcoming of reluctance to 
handle live thinS^, the insight into the "discovery" method, the dis- 
covery about pupil potential, and the realization by ueachers that 
science is not a static subject. 

Major weaknesses were; Not enough training for supervisors, super- 
visors should be an active part of the pre-planning; not enough time 
for supervisors to meet with their groups for discussion; insufficient 
amounts of materials; the lectures and the kinnescopes; the testing 
program and the physical facilities. 

In making an over -all appraisal of the Institute one supervisor 
expressed the opinion shared by many supervisors and participants; 
Teachers learned many things, including the "intangibles", despite 
their own "willingness to e:q)res3 grievances about the program". 



SUMMARY AND CONCLUSIONS 

During a six -week period in the Summer of 1966, under a grant 
from the United States Office of Education, 221 teachers from I 4 I 
different schools in New York City and its environs completed an 
NDEA Institute workshop. These teachers, predominantly female, tended 
to be young and with relatively little prior teaching experience. 

Nearly all of the group had been education majors, having somewhat 
more than the semesters hours necessary for the baccalaureate degree. 
The teachers were divided into fifteen working groups having between 
10 and 19 members and supervised by either an assistant-principal, 
district science coordinator or peer-leader. 

The general objectives of the NDEA Institute were to increase 
the knoifledge of the teacher-participants in selected basic concepts 
of the biological, earth and physical sciences; to provide them with 
available materials and techniques for teaching these concepts to 
children; to teach them techniques for exploring other science con- 
cepts and generalizations; to teach them to use curricular materials 
to teach processes and generalizations to their classes; to develop 
their teaching style for guiding inquiry in the classroom; and to 
help them master skills in the use of laboratory and educational 
materials and methods for teaching science. 

A year-long evaluation of the effectiveness of the Institute was 
provided for; the planning of the evaluation began in March 1966, four 
months before the start of the workshop. ¥e were interested in changes 
in the teacher -participants as a result of the Institute experience and 
decided on a pre- and post- Institute comparison design, where each par 
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ticipant would be compared with herself. It was hypothesized that group 
affiliatioii might be important, and wherever possible the findings were 
analyzed and present by supervisory group. 

The evaluation x:as (’..Irected toward five areas of interest t changes 
in knowledge and information; changes in attitudes toward science and 
science teaching; changes in teacher behavior in the classroom; changes 
in the schools and in the pupils; and over-all effectiveness and sug- 
gested modifications of the Institute » Nine measures were developed, 
fairly complete results were presented for seven of them. 

The Teacher-Participant and Su pervisor-Participant School Checklist 
was sent to all teachers ana supervisors in April 1966 and March W7. 

A sample of 39 teacher-participants were observed three times in their 
classroom - once prior to the Institute, once immediately after the 
Institute and the third time approximately one year after the initial 
observation - by trained observers using the specially developed Obser- 
vation Schedule; although all participants were to be observed both 
pre- and post- Institute by the supervisor-teachers, this data was not 
complete enough for inclusion. 

On the first and last days of the workshop the teacher-participants 
completed a battery of tests including the Test of Science Concepts, the 
Elementary Science Survey and a Semantic Differen t ial . Added to^Jbhe last- 
day test battery was, aii Kvaluation of the Effectiveness of the NDEA In- 
stitute rating scale completed by both the teacher-participants and the 
supervisor-participants . 

A summary of the major findings follows: 

1, Changes in scientific Imowledge and information - In general, 
the Institute was markedly successful in effecting positive changes in 
the amount and kind of scientific information and understanding avail- 
able to the participants. Not only did participants learn more about 
the specific concepts covered by the curriculum, but there is some 
dication of increased learning in other content areas of the biological, 
physical and earth sciences. Their attitudes toward scientific knowl- 
edge also imdcrx^ent changes. 

At the start of the workshop participants felt that they were most 
knowledgable in biology; this was borne out in the pre -Institute test- 
ing. Gains in biology were not generally as large as the gains in earth 
and physical science, probably because of the initial high level of 
achievement in biology. 

Participants expected to learn more earth, physical and biological 
science (in that ordc:-) as a result of the Institute experiences; the 
results indicated improvement in earth and biological science, and rel- 
atively smaller amounts of in^rovement in the physical sciences. The 
teacher -participants also felt that they received least (comparatively) 
help in the physical sciences, and rated the Institute as much less 
effective in this area as compared with the other science areas. 

2* Changes in attitudes toward Science and Science Teaching - the 
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over-all findings indicate that the Institute had tnore th^ moderate 
success in effecting a positive change in participants • attitudes 
toward science and science teaching. In fact, the single most im- 
pressive result, noted again and again, was the chanp in of 

ease and confidence and an increase in enjoyment with science and 

science teaching. 

The participants themselves anticipated this outcome and rated 
their enjoyment of science as the most iirportant result of the e^er- 
ience. They felt that the Institute was outstandingly s^cessful in 
increasing their enjoyment of science teaching and improv^g 
confidence. The supervisors concurred that the most ^port ant change 
in the participants was in this area of ease and confidence. 

Specific attitudes also underwent favorable changes; 
shifts in attitude were in the personal-related concepts of ly^yself as 
a Science Teacher and % Teaching Skills and Techniques. 
positive changes in attitude occurred toward the concepts of Process - 
Centered Activities and Individualized Science Activities; these in- 
cepts are basic to the theoretical rationale of the Institute. 
participants also said that they became more appreciative of the im- 
portance of pupil discovery and pupil participation. 

On the other hand, the Institute was not particularily successful 
in certain other attitudinal areas, notably with participants’ attitudes 
towards Difficult Students and Disadvantaged Children; nor did the 
Institute fulfill the participants* expectation that they 
come "more effective teachers" as a result of the experience. Neither 
the participants nor the supervisors felt that the Institute was ef- 
fective on the participants' ability to write explanations of sijnple 
scientific concepts nor on their ability to evaluate trade books. In 
addition the teachers felt that they did not receive enough hel^p with 
the specifics of lesson planning, designing and constructing their own 
materials, nor with the sources of materials. 

An unanticipated bonus was in the degree to which the curiosity of 
the participants toward science was aroused as a result of the ' 

In several different contexts mention was made of an increased interest 

in science and scientific phenomena. 

3. Changes in teacher behavior in the classroom - The participants* 
expectation of becoming "more effective teachers" was not entirely 
realized. Not only did the participants themselves feel that ‘the in- 
stitute was relatively unsuccessful in effecting this outcome, ^ut the 
evidence from the classroom observations tend to support this conclusion. 

In general the teaching behaviors did not show the same changes 
that would have been predicted on the basis of test resists. ® “ 

ins behaviors most unrelated to science teaching, i.e., those behav- 
iors characteristic of good teaching in general, changed least. For 
example, there was little improvement in the rating of participants 
ability to direct, focus and clarify the aim of the lesson, little 
change in their ability to permit more pupil planning, collecting, 
organizing and interpreting the data. 




However, the teacher-participants did exhibit more flexibility in 
the subject matter of the lesson taught, and more skill in ending the 
lesson. They also tended to use a greater variety of sin?)le e^eriences 
and examples. There was a positive change in the degree to which pupils 
manipulated materials and in the kinds of pupil groups. In general the 
quality of the lesson inproved and the teacher appeared more at ease 
after the Institute. 

One of the more significant findings involved an increase in tol~ 
erance for what the participants described as ’’chaos” - increased pupil 
participation and Individualized activities which result in more ’’noise 
and more physical movement” in the classroom. Also noted was a tend- 
ency to include more living things - plants and animals - in the lessons 
and in the classroom. , 

The teachers feelings substantiate the observations. The partici- 
pants felt better equipped to teach science and they were more co^ifort- 
able with materials, instruments^ observation and experimentation as 
well as with small group instruction. They indicated however, little 
change in their ability to design their own materials, to direct and 
focus attention on the problem being cotisidefed, to lead discussibns 
of the findings and to conduct summarizations that answer the 
question and raise new, related questions. 

Changes in the schools and in the pupils - Little direct data 
on changes in the school and in the pupils was available. In general, 
there seemed to be few changes in the schools represented by the par- 
ticipants and whatever structural and organizational changes did appear 
cannot necessarily be attributed to the NDEA workshop. 

Several participants were given science cluster or OTP responsi- 
bilities in their schools as a result of their special training; others 
acquired additional science responsibilities. Primarily because of 
change in assignments and scheduling there was little evidence that 
more science was being taught in the schools after the Institute. Al- 
though many participants expressed the inadequacy of the existing sci- 
ence curriculum and materials, others indicated that as a result of the 
Institute they were better able to realize the potentials of the avail- 
able materials and equipment. 

There Were some interesting findings with regard to changes in 
pupils. Participants and observers tended to rate level of pupil in- 
terest in science higher after the Institute than before; in addition, 
a greater proportion of pupils were seen as highly interested. 

Participants also found that pupil ability was greater than they 
had believed prior to the Institute and the participants judged them- 
selves as significantly better than average in their own ability to 
evaluate how well pupils have mastered a concept. Perhaps more im- 
portantly was the realization by some participants that teacher at- 
titude directly affects pupil attitude. 
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^ Overview - The variety of individual responses ^d the variety 
of group responses! although evident throughout the results, are espe- 
cially apparent in the findinca dealing T-dth modifications and sugge^ 
Uons fofthe Institute, ^or every npro-- there was a ncon^ 

Hbest'S a »worst% but over-all it is obvious that the 1966 1©EA 
stitute in Science was a success; in general, most came ^ 

ence- most felt more confident and at ease in teaching science, m^t 
ffilt^well-eauipped to teach science and most of the participants 
that the Institute was successful in imparting 

and in teaohing participants individualized techniques and in improving 
their own attitudes and increasing their own interest. 

A large proportion of the suggestions concerned the selection of 
participants Ld supervisors. The teachers felt that 
Lould be paid to the needs of disadvantaged children, to lesson pl^ 
nlhg and to materials and eq\iipment that would be available to 
in the Lw Yofk City classroom. They suggested improving the Q'lality 
0 ? the SetSes and lecturers and the Kinnescopes - perhaps substit- 
uting work with Ohildren. There was much emphasis on the physical 
surroundings as well* 

Different individuals and different groups mde 

based on their ovm backgrounds and on the ^^^M^tLt thev 

had during the summer. All but a very few individuals felt that they 

got something of woro’i from the Institute. 



LIMITATIONS OF THE INSTITUTE, THE EVALUATION, AND 
STinOESTED MODIFICATIONS AND IMPROVEMENTS 



1. Selection of the Participants - There is some question about 

the selection of the paruicipants . The 221 ^ ' 

stitute represent a rather heterogeneous group, in age, experience, 
school assignment, grade level assignment and in 

tivations. preparations and backgrounds they bring with them. Sev 
erll ofthe pSticipants themselves noted uneven degrees of interest 
in the Institute and expressed concern with the motivations 
collea;<uies. mile it is important to restriet tte acceptance of par- 
ticipate to the criteria laid down, some modification “L 

^rtioipants (see below) may provide a more adequate solution to the 

problem of heterogeneity. 

2. .q>=^ifin tion of the Supervisors - In a large size Institute of 
this sort7where most of the learning is to occur within ^oups, the 
selection and role cf the supervisors play a ^ey part. 

q+ltute sunervisors were either Assistant-Principals, Distri 
ence Coordinators or Peer-Leaders. Although 
parisons and intercorrelations by groups were 

minb evidence to suggest that the supervisor may make a difference. 

However, it is impossible to state conclusively, for ?itest"^’ 

which if any of the types of supervisors represented, is the best 
type. Firstly, the groups differ in size from 10 to 19 per groi^. 
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Secondly, the groups are randomly composod of teachers from one to four 
different schools, /^.d thirdly, the groups differ in and kinds 

of homogeneity. Dcpoiidin,' on i-.-lioh recuabj -wJ. o.^ 0 xC at different 
factors, including Tdrio the sr.per-risor is, become important. There is 
some indication, for c:^ar.ple, that if you are pr^arily interested in 
increasing amount of scica'vifio l.-novXedKS, district coo^inators my 
represent the "t ..■:ioioe." ?8er-l;ad.^rs ond Assistant-Principals 
may jrepresent a good choice if you arc iiitcrested in school- e 
changes. 

The formal title of the c^’cU? cuporviscr may bo of lesser im- 
portance than some itrvo peroon-iX chaiaotoriotics of, for 
itell does the suporrir,-;r too" the participants, role he nave 

lytheir selection, is he a "fightor" for the "rights" of his group, etc, 

3. Size of Total Grou p and Gro ups - There wero many indications 
that, as organized for this Institute, tho size of the total gno^ 
the kze and interactions cf tho indit-iinal groups present so^ hazards. 
Obviously a group of more than 200 porsons cannot physicaUy fit in 
ordinary, every-day surre-undings and cc.rnot have equal materials. Some 
botid to get to tho auditorium or library first and avail 
themselves of the better scats, bcol.o, etc. Some supery..sors may^be 
better than others at this alsoo If the ciao of the to ^al group is no 
limited, much more careful groiip.lng is iriiicated, Tdth a view to elim- 
inating withii'i-^^roup 

As noted, althou.gli some participants felt this was a pod oppor- 

--0 -• — — .-^. 1 .. n ‘'-v-io T/T 3^3 net the primary pur- 



tunity to "meet a lot of nice j 1 4 .v,« 

pose of the Institute, Perhaps groups should ce established on the 
basis of diagnostic tests of p---or proparaMon and bac.kgpund, on the 
basis of grade ].cvel taught, cr on other her is facil- 

itate small-group instru ction. At any Tcito^ all^ groups should be Pro- 
vided with essontia2.1y comparaele rauerialsj scnedules of use . , 

facilities can be arranged - scemiS to be no reason for the total 

group to view together the Kir-ue scopes, for euample, although of course, 
some of the outside lectures may he more difficult to schedule. 

li. Physical fao.U.ities - Unfortunately the physical facilities 
of the Institute play an important part, especially to the participan s. 
The inaccessible elcmonbary school building, the small rooms, the \m- 
air-conditioned" envirormient and the library and aucitorium ranked high 
on the list of compla:u:.ts . Ib is suggeated tnat, if possible, the sur- 
roundings should be made as ccmfortable as possible, primarily in order 
to minimize their importance. It weald also appear to be 
try to arrange that tho workshop be he3.d on a college campus for sev- 
eral reasons: to provide the participants .d.th a real sense of obtain- 
ing college credit for thsi:.' wh_c]x in uurn i.::y main ^ain their in- 

terest and improve their motiva.tiori7 the college campus ijsual y as 
large enough rooms, Icc-'-uro hails and laboratories as well as eating, 
parking and other f acilibies , 

5. Expectations - As notod in the results there is of'fcon extreme 
variance between the expectations of the participants, and the goals 
inplicit and explicit - of the InstiWiG, The variance between these 
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sets of expectations often leads to dissatisfactions, and sometimes to 
feelings S "betrayal." If all objectives of the Institue and some of 
the^er lying theo:.’s tioal fomidations were made explicit we feel it 
would not only negate some of the general dissatisfaction but would 
eliminate these few participants who may have applied "for the wrong 

reasons" 

6 ‘'Action-Research" - There are, of course, limitations in any 
actionlres earch pf 5i?Sr Throe of these limitations to discussed 

in detail, (1) the assignment of teachers, (2) the problem of non-re 
spondLts aM, (3) the total-impact nature of the evaluation. 

One of the conditions for acoeptahee as a P?>^toipant was ^ 

on the part of the applicant that she 

the same school (same as during the school y®®** tS^sLtion 

a„T■^no the year after the Summer workshop. As described in the section 

o^tof "ResSts of the Teacher-Participant Ctociaist">^there were a 

great many changes in teaching assignment - ^^om ®chool-to-schpol, 

between grades* on the same grade but different level, ® 

fLt very few teachers actually remained with Jhe i®Wo4^d 

grade cl^ss. Not only did this mobility make 

after comparisons difficult, it also may have tended to dilute the 
Sl-Se impact of the Institute program. This reasSig^ent of 

personnS (including too of 

results from the rather siri 5 )le measures dealing with the adequacy oi 
materials to the costly and t?mie-oonsuming classroom observations. 

The evaluators found it e:ctremely difficult to compare one t 
™ a bright first-grade class with her ^ perfoimance one J^Sl^ 
as a cluster teacher doing a "demonstration" lesson with a middle- 

level third grade class. 

Wiile it is not our intentlcn to impose conditions on the school 
system it can be suggested that perhaps some provision be mde for all 
teachers involved in a research project to receive special consider- 
ation as regards assignment. The alternative may be to base comparisons 
only on those persons ’.rith the sane assignment for the years covered 
by toe project! Hotjever, since we do not know exactly ^ faLlL 

any class of reassignment represents, treating the data in i 
may seriously bias the resiiltso 

Closely related to too reassignment of personnel this in- 

stance, the problem of non-respondents. In this study *‘*®^®. 
types of non-respondent j those who did not return a form 
oSy partially con^jleted a form or test. We are more couched with 
thore^rsons who did not complete and return an entire form. 

In general the per cent return on any one item tended to to mr- 
ly high, especially for the pre-institute administrations. After the 
tostitute tLre were signifioaotly fewer responses to toe in 

particular, and a few end-institute instances where toe^^ 
did not return the Test of Science Concepts, the Elementary Science 
Survey, the Semantic Differentia and toe totems, to 

addition, one of the sample teachers ooserved in the classroom refus 
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to be observed after the Institute and one or two others were absent 
on that day. It is vary tempting to hypothesize that the non-respon- 
dentfare a group of (..issatisfxed participants expressing their dis- 
satisfaction in this way. Howaver, i-ie can not easily 
pothesisj there is some data which suggests that dissatisfied Partici- 
pants are interested in actively expressing their con^laints - *here 
Sere several quite r^ehement "gripos" noted. Perhaps the non-respondents 
represent a more apathetic group or perhaps may to the group ttet has 
moved away (as is suggested in the responses to the Checkli st , ) 

A third problem common to any action-research program 
impact" nature of the program and of the evaluation. With this ° 

design it is nearly impossible to attribute the outcomes to any specific 
variable - activity, schedule, personnel, etc. It is entirely possible, 
althohgh not at all likely, that the positive outcomes in science ta- 
formatlon for example, may be attributable to the number of time 
participants read the brochure rather than to either 
oratories or assigned readings. In fact, ® 

design it should be possible to determine which vartable actually pro- 
duced each specific outcome. This would save great amotots ^ 

money; if we could determine which variable or combination of vartables 
produced which results we would have to replicate only the sig^fio^t 
features in a similar situation to produce similar i'esults. although 
this type of design requites greater control than is usually available 
in education - research proiocts* some attempt should be made to par- 
allel this desigr as closely as possible, 

7, The Tests and the Testing - It is important that the battery 
of tests be adminisF* red under “better physical conditions than pre- 
vailed in this studyo In addition, perhaps the initial es- 
pecially those tests purporting to measure ^ 

formation in the participants’ background, could be administered tefor 
the start of the Institute and be used diagnostically for the purpose 
of homogeneous grouping. 

With a few exceptions described below we. were generally satisfied 
with the instruments used in this study. However, more time was needed 
Sr the development of alternate forms of the Test of 
and the Elementary Science Survey . lrh.thout the use of aiernate 
or some "control" data cri practice effects, is is impossible to attrib- 
ute all of the significant gains obtained to learning, rather than to 
the test-retest situation. As an alternative to comparable forms, some 
data on practice effects should be collected on a control poup of 
teachers; the same time interval between administrations shoul * 

It is suggested that this irlghb be the better procedure with the E l e^- 
tarv Science Survey, but alternate and comparable forms of the Test of 
Science Concepts ^hou3.fi be developed. 

More time for planning and trjr-outs may have reduced the amount of 
inter-rated disagreement on the items comprising the Classroom Behaviqr_ 
Schedule. As noted in ohat section of the results, there^was “‘^ohjis-^ 
agreement on several items; although some attempt 

personal bias, we feel it was largely ineffective. The addiUo^ n^d- 
ed time could be ussd either to train the observers and/or to siiiplify 
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thB Items- it is hoped that either suggestion would result in better 
JSteSd agi^emSt and more reliable results. The data also indl- 
cates that due to teacher raobility, sickness, etc. more particlpa 
should bo observed initially. 

several questions in the Checklist were 
did not seem to understand exactly what was 

that in the future, questions concerning amount of time spent, eiiecuive 
iney"tlve Sng\ids. equipment, field-trips, etc. either te e^- 

inated from the form, or simplified. More attitudes 

the participants' responsibilities for science and to their atm 
concerning the kinds and levels of interest and potential exhibited by 
the pupils in their class <> 

T.r« 4*001 +.viat the Effectiveness Rating Scale ^^ta.s a very useful and 
infon^ti^ instrument— It is the only 

directs the participants to the objectives of the Institute. In ad 
dition, it provided the participants with an opportunity to egress them- 
Ss and in Seir own words* These open-ended items permitted the 
flavor and characteristics of individuals to emerge and P'®®®"*®'* “ ^ 

with a wealth of suggestions that we Would not have obtained had we used 

only structured forms i 

One final word about the tests Used in the evaluation. While we 
are all of the opinion that the Semantic Differential was one of the 
most invaluable measures used, the time needed to score Pf°°®®® ?'® 
data may discourage its use in the future. Although it is fairly sim- 
ple to develop a machine-scored answer sheet of the ’ 

some care must be takon to assure comparability of results with tjiis 
type of form and the format suggested by Osgood. 

fl. Treatment of the Data - It is obvious that there were gaps 
in the statistical trsaiment ’of the data. First and *^® 

absence of interoorrelations between variables. Secondly, g 
alized distance formula used by Osgood was not used to analyze 
results of the Semanbic Differential . And lastly, most of the data 

was treated fairly simply. 

We are of the opinion that due to the confound!^ of variables 
and the things over which we had little or no oontrol,more sopWsti- 
Gated statistical analyses would be presus?)tuous. We would like to 
have had the time to present interoorrelations between factors we 
hvpothesize as related, however, and would have liked also to in- 
Se all data by groups. The data is available for all comparisons 

and may be reanalyzed in the future. 

9 . As pects of to Institute not covered by the Evaluation - Not 
much of an attempt was made to evaluate certain aspects of In- 
stitute that might or might not be important. For J; ® 

we asked the supervisor-participants to complete ^ Effectiven^ g | 
rating, there was no folloir-up attempt to secure the ^^si S • 

In addition, we have little concrete information about the ^ 

Interest in and amount of knowledge of science that the ^uper^sors 
have; more importantly, we have only a smathering indication of their 
effectiveness with their om groups. 
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All of our interest was fooused on the ^“her -^d “Ot as^ tool 
+he learning process, tut rather as an end in itself. 
toS^ Lsumptfon that a change in ® 

^Biiit in a change in pupil achievement. Aside from a few classroom 

Sservatlons, primarily directed towarf Ch|inges to 

havi:hr, this evaluation did not seek to measttie ™® that 

the teacher in raising the achievement of pupils. 

ultimately the success of at£ educational program must . 

terms of a positive change in pupil success 4 ? . .ion about 

classroom observation of teaching tehavior will yield inf 

how much children are learning* 

It is possible that without knowing much science a »go^" teacher 
mav be able to lead pupils to discover for themselves, may instill in 

S ?upSs tS: c'io^toy and attitudes '^t‘'-V‘^®^lbir®irif S' 
ing of science and scientific processes are not possible. ^^ain 

pofsible that a teacher who makes mistakes, who is 

struments and equipment may foster the necessary 

an^Sation of science. This is not to suggest that we should not 
try to make our teachers more knowledgable and more 
i/necessarily mean that we should not try to ^easure 
we were in tr^ng to do this; but rather, we should 
a preliminary step in the ultimate objective of improving 
Lg of wiS in the classroom. ^ The criterion against which to meas- 
ure program success mast be pupil achievement. 
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NDEA INSTITUTE IN ELEMENTARY SCHOOL SCIENCE 
STATEMENT OF OBJECTIVES FOR TEACHER-PARTICIPANTS 



Pr ocess Oriented Teaching Behaviors 

Each participant should demonstrate teaching styles appropriate for 
guiding inquiry in his classroom: 

A. Directing and focusing attention on the problem being consideredj 

B. Organizing and leading individualized and/or small group observation 
of a natural phenomenon; 

0. Conducting discussions of the findings of individuals and/or small 
groups with regard to a natural phenomenon; 

0- Raising pertinent questions about findings and encouraging such 
.•’•'.estions from individuals and/or groups; 

Jicading summarizations so that while original questions are 
answered, new and related questions are raised; 

• , E?:plo:’.ting '■•ha findings of individuals to extend and expand the 
ii.quiries oeing conducted. 



Each pa r ti dp c n t 



should be able 'bo: 



A- Examine s donee trade books and abstract their content; scan books 

for their appropriate and pertinent concepts; write brief explanations 
■po'’bi:r.- 2 i!.t concepts. 



B. Sr/.Lac-b appropidate experiences through which children may achieve 
.o-nc'-epto; test perceptual experiences to determine how well they 
'..mono .brate a concept. 



C. -. S'<cp?.oit e::tant m.aterials for presenting concepts to children, 

D. Evaluate the extent to which a group of children and/or an individual 
child has mastered a concept. 



E. Select from home and community environment experiences which can be 
utilized in the development of science concepts. 



Skills 



Each participant should demonstrate a mastery of: 

A. Use of simple materials for teaching science concepts and processes 
to children; coordinate use of textual and laboratory materials. 

B. Planning simple experiences with which to teach science concepts and/or 
processes to children; designing simple materials with which to teach 
science concepts and/or processes to children. 
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.■■'V oC Objectives for Teacher-Participants - 

(’'continued) 

C. Usin^ ciFiplo ccientific instruments: thGri.iomjte. S"ass or plastic 
rare, simple chemicals: gathering, organizing, and interpreting simple 
data; plamiing and executing simple experimental procedures; using 
models to study and explain natural phenomena. 

Know^ .edges 

Each pa-^ticipant should demonstrate knowledge of the following concepts: 



:he 



Ac 'i‘er,'pr:rature can be measiired; 

A thormometoi' ±3 one instrument for measuring temperatures; 

The ievrel oi the indicator in a liquid thermometer changes as t] 
temperature varies; 

I-iatter can exist in solid, liquid, or gaseous state; 

When matter changes from one phase to another, an exchange of heat 
is generally involved; 

Heat is energy in transit dis;:$ to temperature difference. It moves 
from a source (hotter matter) to a sink (ccl-der matter). 

Matter generally expands when heated; matter generally contracts when 
ccjled. , 

E. Motion occurs when a body changes its place or position relative to 
a chof on frame of reference; 

Direction of motion is described with respect to a chosen frame of 
reference; 

A body can undergo simultaneously a combination of motions 
(translation, rotation, vibration); 

The earth is round (spherical); 

The earth rotates; 

Day and night are results of the rotation of the earth; 

The ea^cth is in constant motion relative to the t. the earth 
revolves and rotates simultaneously; 

C'=^rtaju phycinai conditions reculi frem t’nc motion: day and night, 
seasons . 

C, Many aaimai offspring resemble their parents, but they are smaller; 

Auiri'ils including humans, gi’ow; the parts of their bodies grow; 

New plants can grew from seeds, from bulbs, or from tubers; 

The pi'incipa]. parts of plants vary in appearance from one species 
to another; 

growth takes place at specific places in the plant; 

-0 j.r.u.;.s respond to stiraulae in their environments: light, moii.bure; 

Plants o’espond to stimulae in their environments: light, gravitation, 
raoisture , 



It oho'.ad be noted that each of the sub-di^^sions of any of the three large 
headings can be sub-divided into further, valid, but less general, concepts, 
•lach sub-concepts, sub-skills, or sub-techniques very well may be of use in 
.vf lu.r ig cither the teacher-participants individually or ttie program generall 



NDEA INSTITUTE IN ELEMENTARY SCIENCE 
SUPERVISOR-PARTICIPANT SCHOOL CHECKLIST 






> 



School ( boro ) : Date t 

Supervisor-Participant Name: 

1. During 196^-66 what was your official position in, or relation with, this 
school? 

2. Do you expect any change in position or assignment in, or with relation to 

this school next year (1966-67)? Yes: Not If yes, please describe 

briefly. 

3. In grades K-ii, is there a weekly time allotment for science instruction? 
Please indicate for each grade the amount of time per wedc scheduled for science-. 

K: Grade 3? 

Grade 1: Grade U: 

Grade 2: At teacher* s discretion (specify grade}; 



U. Is there a special science program in this school? Yes: No: 

If yes, please describe briefly (include grades involved, number of teachers, etc } 



5# Is there a special science room in this school? Yes: the room 

used for all science lessons, all grades, special demonstrations, etc.? Please 
describe briefly; 

Who is responsible for maintaining this room? 

6. Is there a school library? Yes: No; 

Is there a collection of science books? Yes; No; Approximately what 

percentage of the total collection is science (i.e«, ^00 and 600 books in the Dewey 
system)? 

Is there a state-certified librarian? Yes; No; If not, who has general 

over-all responsibility for the library? 

By whom are science books selected? (By committee, individual teacher recom- 
mendation, Board of Education, Principal, etc. Please describe specifically): 



What criteria are used in evaluating science books? 



Who evaluates the science books? 

How are teacher.s informed of new library acquisitions related to science? 

What science books were ordered for the coming year, 1966-67? Please list (use 
back of page if necessary); 



SUPERVISOR-PARTICIPANT SCHOOL CHECKLIST - page 2 

7. Are science materials, supplies and equipment stored centrally? 
Yes: No: Please describe briefly: 



How are materials borrowed from the central supply? 

Are there enough supplies, materials and equipment for individual pupil experiences 
Yes: No: Please specify; 



What new supplies, materials and science equipment were ordered for the coming 
year, 1966-67? Please list (use back of page if necessary): 



8. Is there a specific person assigned responsibility for science supplies, 

materials and equipment? Yes: No; Please indicate the title of the 

person(s) who is responsible : 

Is this person(s) responsible for: 

Suggesting and requisitioning materials: Yes; No: 

Maintaining and repairing materials and equipment; Yes; No; 

Evaluating materials and equipment; Yes: No; 

How are priorities for purchase determined? Please describe briefly; 

How are teachers informed of new science acquisitions? 



9. Please indicate, by circling the appropriate number on the scale, the general 
level of interest with and involvement in science in this school: 

1 2 3 U 

Somewhat less Average More than Science - 

than average interest average interest oriented 

On what factor or factors do you base this general impression? Is there an 
annual science fair in the school, are there science exhibitions and displays, 
is there a science competition, etc.? Please try to be specific in describing 
your impression of the interest level in science in this school. 



Additional Comments: 



NDEA INSTITUTE IN PRIMARY GRADE SCIENCE 
Hunter College 

TEST OF SCIENCE CONCEPTS 



INSTRUCTIONS 

This test consists of six reading passages on different science subjects 
and seven multiple choice questions for each passage. You should read 
each passage carefully and then answer the seven questions on that passage. 
After you have finished one passage go right on to the next one. There is 
no tiofie limit on this test, but try to work rapidly. 

Answer all questions; on the separate DIGITEK answer sheet by blackening 
the space corresponding to your choice of the best answer to each question 
or the best completion to each incomplete statement. Please DO NOT WRITE 
IN THIS BOOKLET . If you wish to use scrap paper, you may. Be sure that 
your name is clearly PRINTED in the proper spaces on the answer sheet. 



(Questions 1-7) 



Suppose you are looking at the street and you see a car to your right. 

If you close your eyes and then look again two seconds later and the 
now^on your left, what do you assume? You probably assume ttot during the 
seconds when your eyes were closed the car moved from your right ® ttIivh 

But, since we are supposing, suppose it is the y^r 2,000 A.D. ® ® 

you are standing on is really a very smoothly moving belt. If 
were shut, it moved you toward your right, the result would be the same, t 
car would appear on your left after you opened your eyes. There is one more 
possibility; both you and the car moved while your eyes were closed. 

Could you decide what had happened? You could not, if you and tte car 
were the only things on the street. All you could say is that you and the car 

were in different positions with respect to each other before you 

after you opened your eyes. A more precise way of saying this is that your 

^lative positions were changed. From your point of "^ew, or, 

from a fr^e of reference attached to you, it may be said that the oar 

relative to you. From the driver's point of view, or from ® 

attached to the car, it may be said that you moved ‘he gees 

what the driver sees; first he sees you out of the front window, then he sees 

you in the rear view mirror.) 

If there were a third thing on the street, for exaii?)le a tree, then you 
might be able to be more definite about who moved. If you and the tree were 
in the same relative positions before you shut Y®"*’ ®y®® 

them, then you would probably say that the oar moved, pis is pat w® do all 
tte tim^ i pick a Reference point or points (ipe a tree) and af pmet^g 
(like a oar) changes its position relaUve to that r^erence popt ^r pame 
rtf -H^fprpnce) then we say it (the car) has moved. In precise terms, the 
car has moved’ relative to the frame of reference. Since we took as our reference 
TOint something which was firmly rooted to the earth and which we 
Sot move relative to the earth, we can say that the car moved relative ^ the 
earth. (Remember, our whole problem arose when we wpe not sure if we had 

moved relative to the earth. ) 

Wien we speak of motion which takes place on the earth, normally 
assume that the earth is our frame of reference and things are ^|^oving re ^ 
to the earth. However, anything which is convenient may be used as 
of reference. For example, it is more convenient mathematically to 
sun as a frame of reference when discussing the motions of planets 
solar system. 
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Suppose you are sitting on a train which is moving (relative to the earth) due 
west at a constant speed of 35 miles per hour. You stand up and start walking 
toward the rear of the train at a constant speed of 1; miles per hour (relative 
to the train). 

1. How fast and in what direction are you moving in relation to the earth? 

(l) 35 iTiph west (2) 39 iriph west (3) 31 raph west (U) h iriph east 
(5) h inph west 

2. As you walk, how fast are you approaching and passing seated passengers? 
(l) i; mph (2) 31 mph (3) 39 mph (h) 35 inph (5) 8 mph 



3. If while you were walking toward the rear of the train, ;just as you entered 

the i'ront of a car, someone else entered the back of the car and he was 

walking towards the front at 5 iriph (relative to the train). What would be 
your speed and direction relative to him? 

(l) k mph toward him (2) hh mph toward him (3) 9 iriph toward him 

(U) iio mph toward him (^) 5* iriph tovjard him 

U. In the saiTie situation as number 3} what is the other person’s speed and 

direction relative to you? 

(l) $ mph toward you (2) 39 mph toward you (3) 9 iriph toward you 

(li) h mph toward you (5) hh mph toward you 

5. Suppose a car is driving at hO mph west (relative to the earth) on a road 

paralleling the train track. How fast and in what direction is the car 
travelling relative to the train? 

(l) liO mph west (2) 7^ mph west (3) 35 inpH west (U) 5 i^pH west 

(5) 5 mph east 

6 . How fast and in what direction is the car in number 5 travelling relative 

to you as you walk toward the rear of the train? 

(l) liO mph west (2) 71 mph west (3) 39 mph west (1|) 9 mph west 

(5) 1 mph east 



7. As you are walking toward the rear of your train, a freight train passes 
you travelling east at liO mph (relative to the earth). A man is walking 
along the top of the box cars toward the rear of the freight train at 5 mph 
(relative to the freight train). How fast and in what direction is the man 
moving relative to you? 

(1) 35 mph east (2) hO mph east (3) 75 mph east (h) 66 mph east 
{$) 81i mph east 



ERIC 
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(Questions 8 - lii) 



1 



In general, as heat is applied to a substance at a constant rate, its 
temperature increases at a constant rate (which depends on the physical state 
or phase of the material), until either the melting temperature or the boiling 
temperature is reached# At either of these temperatures, the application of 
heat does not produce a temperature change until all of the substance has 
changed phase. 

Some types of materials, called elements and compounds, react in unique 
ways when heated at a constant rate. When a solid piece of one of these 
materials is heated in this way, its temperature increases at a constant rate 
until it starts to melt - that is, until it reaches what is called its "melting 
temperature." At its melting temperature, even though heat continues to be 
applied to the material at the previous, constant rate, the temperature of the 
material remains the same until all of the solid has been melted. 

Only after the solid has completely melted will heat again affect the 
temperature of the material. However, when all the material has turned to 
liquid, as heat continues to be applied at the original rate, the temperature 
of the liquid once again rises at a constant rate. But one thing must be 
noted. Even though the heat is applied at the same rate for both tht solid 
and then the liquid, the rate of temperature increase for the liquid form of 
the material is not necessarily the same as its rate of temperature increase 
in solid form. With the continued steady application of heat, the temperature 
of the liquid material continues to rise at this constant rate until the liquid 
starts to vaporize - that is, until it reaches what is called its "boiling 
temperature." At its boiling temperature, even though the material continues 
to be heated at the previous, constant rate, the temperature of the material 
does not change until all of it has boiled or vaporized. Once all the material 
has changed from a liquid to a gas or vapor, then with the constant application 
of teat, the vapor's temperature once more rises at a constant rate. But, once 
again, the rate of temperature rise for the vapor is not necessarily the same 
as the rate of rise in temperature of the liquid, nor is its rate of tem^rature 
increase necessarily the same as it was when the material was in its solid s a . 
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The graph below shows the temperature of a substance (starting as a solid at 




(l) solid (2) liquid (3) vapor (1|) part solid, part liquid (melting) 

(^) not enough data to tall 



9. 



k 



time 



’•711 



uii0 



suosT.a 



solid (2) liquid 
(5i not enough aata .0 



,ncc was in what phase? 

(3) vapor (1|) part solid, part liquid (melting) 



10, During what tirro period is the substance vaporizing (changing from liquid 

fr. vapor?) 

(1) "A" bo ’'C" (2) "C" to "il'' (3) "E" to "G" (1|‘ ’’G” to "I" (5) "I” to ”K” 



11, The melting temperature of this substance is 

(1) IC" G d) 30" C (3) ^0° C (U) 60° C (^) 76° C 

12, Under these conditions, thj,s substance is a liquid between what two temperatures? 

(1) 10 - o0° C (2) 30 - ^0° C (3) ^0 - 76° C (U) 76 - 100° C 
(^) 10 - ioo° C 



13. Under these conditions, this substance is a vapor above what temperature? 



(1) 10° c 





u) 6Ci' C (h) 76° C (5) 100° 0 



111. If the rate of application of heat were changed, the graph would look 

(1) the same because rate of application of heat does not determine the slope 

(2) the same because rata of application of heat does not affect the melting 
and vaporizing temperature 

(3) somewhat different because the melting temperature and vaporizing 
temperature will be tho same, only the slopes of the lines iTill change 

(U) somewhat different because the melting and vaporizing temperature will change 
(i?) very different because the number of plateaus will change 

-U- 



(Questions 1 $ - 21) 



The response that a plant makes to a stimulus is called a tropism. 

When the stimulus is gravity, the response is called geotropism* When the 
stimulus is light, the response is called phototropism. When the stimulus 
is water, the response is called hydrotropism. XJhen the stimulus is pressure 
from a solid object, the response is called thigmotropism. If the plant's 
response is to grow or move toward the stimulus, vhis is called a positive 
tropism. If the plant's response is to grow or move away from the stimulus, 
this is called a negative tropism. For example, plants grown indoors near 
a sunny window nearly always tend to grow toward the window. This is an 
example of positive phototropism. 

The complete mechanisms of tropisms are still the subject of study, 
but much is known already. It is believed that tropisms can be explained 
by chemical reactions. The stimulus causes certain chemicals to be produced 
in the plant (for example, auxin) which either cause or inhibit growth in 
a certain area of the plant thus making the plant grow toward or away from 
the stimulus. 

Animals also respond to such basic stimuli as light and water and 
chemicals ( chemotropisms ) . "In zool s ’’, a tropism is an unavoidable response 
of an animal to some environmental stimulus involving the orientation of the 
body in relation to the causative factor. In very simple animals this 
reaction is common. Protozoans, for example, may always move toward or 
away from light, and even animals with organized nervous systems, may have 
some nerve paths associated in such a way that a given condition always 
evokes the same reaction." (Van Nostrand's Scientific Encyclopedia, third 
edition, D. Van Nostrand Company, Inc., Princeton, New iJoTsey, 19^8.) 

More complex responses to similarly basic stimuli are often termed 
instincts. For example, it has been demonstrated clearly that certain birds 
navigate by the sun during migration. That is, the stimulus of the position 
of the sun and the time of day elicits the response of the direction of the 
bird's flight. 



15. Some plants (for example, English ivy), tend to grow away from light. This 
is an example of 

(l) positive geotropism (2) positive phototropism (3) negative geotropism 
(k) negative phototropisra (i?) negative hydrotropism 



l6. The roots of certain plants tend to grow away from drier soil and towards 
moister soil. This is an example of 

(l) positive hydrotropism (2) positive thigmotropism (3) positive geotropism 

(i+) negative hydrotropism (^) negative geotropism 



17. When a morning glory grows up a post, curling around it and clinging to it 
as it grows, this is an exa/nple of a combination of 

(1) positive geotropism and negative thigmotropism , 

(2) positive geotropism and positive thigmotropism 

(3) negative geotropism and positive thigmotropism 
(U) positive geotropisiii and positive phototropism 
(5i) negative geotropism and negative thigmotropism 



18. If the leaves of certain plants such as mimosa are touched, they tend to 
close by folding both sides in toward the center. This is an example of a 

(l) hydrotropism (2) chemotropism (3) phototropism 
(k) geotropism (^) thigmotropism 

19. Many protozoa react to the hydrogen ion concentration (pH) of the medium 
in which they are placed. This is an example of 

{],) chemotropism (2) hydrotropism (3) geqtj^'opism 
(k) thigmotropism (^) phototropism 



20. Suppose there is a protozoan with a negative phototropism and a positive 

chemotropism towards hydrogen ions. If you place a number of these protozoa 
in the system diagrammed below, they will probably 



21 . 



(l) not move (2) line up along side AD (3) line up along side BC 
(U) congregate near point B (5) congregate near point D 



Region of low 
hydrogen ion concentratibrf 



Region of high — ^ 
hydrogen ion concontraticni T^ 






(PRQTAm^ 



ZZZZZ273 




The fact that most trees grox^ing on a steep hillside grow vertically, not 
perpendicxilar to the slope of the hill illustrates that geotropism 



(l) is often accompanied by phototropism (2) is a response to gravity 
(3) can be altered by the slope of the land (U) does not affect trees 
(^) can be accompanied by thigmotropism 
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(Questions 22 -28) 



All systems of chemicals contain energy, part of which is due to 
the temperature of the system and part of which is due to the nature of 
the particular chemicals and compounds involved in the system. Syst^s 
of chemicals tend to change from conditions of higher energy to conditions 
of lower energy. Such changes often involve chemical reactions in which 
the products of the reaction are chemicals whose energy is less than that 
of the reactants. 



Before a chemical reaction can take place, however, it is usually 
necessary for a relatively high energy intermediate to be formed by 
combination of the reactants. The energy needed to form this intemediate 
is called the activation energy and generally results from random thermal 
collisions of molecules. The intermediate breaks apart into the products 
of the reaction with a release of energy. If the amount of energy released 
is greater than the activation energy, then there is a net loss of energy 
from the system, leaving a lower energy system. Reactions of this type 

tend to take place. 

If a positive catalyst is introduced into the system it will not 
affect the net loss of energy, only the rate of the reaction. Many 
catalysts act by complexing with the reactants to form an inteme^ate 
of lower energy than in the uncatalyzed reaction. This means that the 
activation energy of the catalyzed reaction is less than that of the 
uncatalyzed reaction. Therefore, the catalyzed reaction can 
more rapidly. But, the release of energy when the catalyzed intermediate 
breaks apart into the prodaots is also reduced (by just the same amount) 

SO the net loss of energy to the system is the same in both cases. 
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Below is a graph of the energy changes of a chemical system as time proceeds 
during a reaction and the system goes from reactants to intermediate to products* 




(1) A-D (2) C-D (3) B-C (k) B-D (^) A-C 



23. The activation energy of the catalyzed reaction is represented by distance 

(1) A-D (2) C-D (3) B-C (i;) B-D (5) A-C 



2k» The loss of energy due to break down of the uncatalyzed intermediate is 
represented by distance 

(1) A-D (2) C-D (3) B-C (U) B-D (^) A-C 



2^. The difference in activation energy between the catalyzed and uncatalyccd 
reactions is represented by distance 

(1) A-D (2) C-D (3) B-C ik) B-D (^) A-C 



26. The net loss of energy in the uncatalyzed reaction is represented by distance 
(1) D-0 (2) A-C (3) A-0 (h) A-B (5) A-D 



2?. The net loss of energy in the catalyzed reaction is represented distance 
(1) D-0 (2) A-C (3) A-0 (k) A-B ($) A-D 



28. If a different catalyst were used, which of the following must be true? 

(1) The rate of the reaction will be faster than with the original catalyst 

( 2 ) The ra.te of the reaction will slower than with the original catalyst 

(3) The activation energy of the new catalyzed intermediate will be less" 
than that of the original catalyzed intermediate 

(U) The c.ctivation energy of the new catalyzed intermediate w in be more 
than that of the original catalyzed intermediate 
(5) the net energy less in the reaction will be unchanged 
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(Questions 29 - 3^) 



The velocity of an object is a vector quantity. This means that it has 
both magnitude and direction. For example, miles per hour*’ is not a velocity, 
it is a speed, because direction is not specified, only magnitude is given. On 
the other hand, ”50 miles per hour due east” is a velocity because both magnitude 
and direction are specified. 

When the velocity of an object has been changed, the object is said to 
have been accelerated. There are three ways in which acceleration can take place: 
first, a change in the speed of an object, with no change in its direction of 
motion; second, a change in the direction of motion of an object, without a change 
in its speed; and third, changes in both speed and direction of motion of an 
object. It should be noted that the change in speed may be either a slowing down 
or a speeding up; both are accelerations. Precisely stated, acceleration is 
defined as a change in velocity over a period of time. 

As an example of the first type of acceleration, consider a car starting 
from rest at one end of a long straightaway. The car is going to accelerate down 
the straightaway an4 therefore, its direction will not change; only its speed 
will increase. Suppose that at the end of the first second it is going 5 mph. 

At the end of the second second it is going 10 mph. At the end of the third 
second it is going l5 mph.... until, at the end of the tenth second it is going 
50 mph. This car is increasing its speed by 5 miles per hour per second. This 
type of acceleration is called linear acceleration because it is in a straight 
line with no change in direction of motion. When a linear acceleration is 
specified as a number with units, there is one distano-) unit ("miles” in the 
example) and there are two time units O'hours” and "secondd* in the example). 

Other types of accelerations are called non-linear accelerations. One 
example is a ball being whirled around in a circle at the end of a string. The 
direction of motion of the ball is continuously changing (even though its speed 
may remain constant), therefore, it is being accelerated. 

The only way an object can be accelerated is if a force is applied to the 
object. The force may be, among other possibilities, a physical push or pull. 

It may be a gravitational attraction. Or, it may be an electrical attraction or 
repulsion. Whatever it is, the size of the force determines the amount of 
acceleration. The larger the force, the greaoer the acceleration. The smaller 
the force, the less the acceleration. If the force is multiplied or divided by 
a given amount, the acceleration is multiplied or divided by that same amount. 

In other words, the acceleration is directly proportional to the magnitude of the 
force applied and in the direction in which the force acts. 

The acceleration also depends on the mass of the object..* The more massive 
the object, the less acceleration will be produced by a given force. For example, 
a 2 pound object will be accelerated only half as much as a 1 pound object if the 
same force is applied to the both of them. In other words, the acceleration 
produced by a specific force is inversely proportional to the mass of the object 
being accelerated. 

The combination of these proportionalities is a statement of Newton’s 
second law of motion: the acceleration of a body is directly proportional to the 
force applied to the body and inversely proportional to the mass of the body and 
in the direction of the application of the force. 



29. Wnich of the following could NOT be a velocity? 

(l) 2^ feet per second up (2) 57.3 niiles per minute east 

(3) h31 miles per hour per second (h) h21 centimeters per second northeast 

(5) 39.6 meters per hour down 

30. Which of the following could be an acceleration? 

(l) 27 miles per hour east (2) 63.9 feet per second per second 
(3) U3 miles per foot per hour (ii) U3 miles per foot per hour 
(5) 67.2 minutes per foot per hour 

31. A car starts from rest at time zero. It accelerates in a straight line. Its 
speed at the end of several of the first ten seconds of its acceleration are 
shown below; 

second 0 1 2 3 h 5 6789 10 

vspeed 0 mph 7.5 mph 15 mph ? 30 mph 37.5 mph ? ? ? 67.5 mph ? 

What is the probable speed of the car at the end of the seventh second? 

(l) 57.^ miles per hour (2) U5 miles per hour (3) ^0 miles per hour 

(k) 52.5 miles per hour (5) 60 miles per hour 

32 . Assuming tha^ it is constant, what is the acceleration of the car in question 31* 

0 ) 5 miles per hour per second (2) 7.5 miles per hour 
(;>) 7.5 miles per hour per second (U) 67.5 miles per hour 
( 5 ) 67.5 rii].cr per hour per second 



33 . If the car in question 31 had been three times as massive but the accelerating 
force had been the same, what would the car's speed have been at the end of 
th-'; fourth second? 

( 1 ) 30 miles per hour (2) 10 miles per hour (3) 15 miles per hour 

(U) 90 miles per hour (5) 60 miles per hour 

3li. If a force of 10 units produces an acceleration of 25 feet per second per 
second of a particular body, a force of 5 units will accelerate the same 
body at: 

( 1 ) 5 feet per second per second (2) 20 feet per second per second 
( 3 ) 15 feet per second per second (k) 2.5 feet per second per second 
(5) 12.5 feet per second per second 

35 . Object number one is accelerated by force number one at 25 yards per second 
per second. Object number two which is four times as massive as object 
number one is accelerated by force two which is twice as strong as force one. 
What is the acceleration of object number two due to force two? 

( 1 ) 100 yards per second per second (2) 6.25 yards per second per second 
( 3 ) 3.125 yards per second per second (U) 12.5 yards per second per second 
(^) 50 rjj’dc per second per second 



ERIC 
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(Questions 36 - ii2) 



All living organisms require energy if they are to continue living. 

Most of the energy used by living organisms is derived from light. The light 
is changed to chemical energy and stored in various compounds to be released 
when needed by the organisms. This transformation and storage of energy takes 
place in those organisms which can perform photosynthesis. These include the 
green plants and some microorganisms. 

Photosynthesis, in very simplified terms, involves the organism 
combining carbon dioxide and water to form, after many involved reactions, 
more complex confounds. The energy for these reactions is light which has 
been "captured" by specialized con?)ounds, such as the chlorophylls. Then it 
is made available for the synthesis reactions. Those organisms which can 
perform the transformation of light energy into chemical energy are called 
"food producers" or, just "producers." 

Not all organisms are producers. All animals and some plants (mushrooms, 
for example) cannot make their own food and must use food which has been 
synthesized by a producer. Such organisms are classified as "cDnsumers." 

Consumers are normally broken down into first-, second-, third-, and 
(sometimes) fourth-order consumers. A first-order consumer is one which 
feeds directly on a producer. For example, a field mouse which feeds on 
grasses is a first-order consumer. An organism which gets its energy by 
feeding on first-order consumers is a second-order consumer. An example of 
a second-order consumer would be a snake which feeds on field mice. A third- 
order consumer is an organism which feeds on second-order consumers. For 
example, an eagle preys on snakes. 

Such a classification into orders of consumers is often helpful, but 
it must not be considered rigid. The eagle mentioned above may prey directly 
on the mice, making it a second-order consumer also. 

There is one other general classification of organisms: decomposers. 
Decomposers are the final consumers. They are (with a few exceptions such 
as toadstools) primarily microorganisms. Decomposers feed on the dead bodies 
of all of the different producers and consumers. The result of the action 
of the decomposers is that most of the con^jounds which were in the dead bodies 
are freed and again can be consumed by producers to be reused in the manufacture 
and utilization of food. 

A single sequence of consumption, such as from light, to grass, to 
mouse, to snake, to eagle, is called a "food chain." But, clearly this is 
not the only sequence in which any of these organisms is involved. Grass msy 
be eaten by rabbits or by cows or sheep. Snakes may eat lizards or toads, or 
many other things. Eagles do not prey only on mice and snakes. When more 
than one sequence is considered and the interconnections among the chains are 
included, the resulting pattern is called a "food web." 
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36# Which of the following does MOT make use of chemical energy that was 
converted from light by a producer? 

(1) a nuclear reactor (2) a coal burning steam engine 

(3) a wood burning steam engine (h) an oil furnace (5) an automobile 

37# Which of the following is NOT essential for photosynthesis? 

(l) a light source (2) a water source (3) a carbon dioxide source 
(ii) an oxygen source (^) a chemical such as chloropliyll 

38. Which of the following is a producer? 

(1) a pig (2) a hawk (3) an algae (k) a human (5) a rabbit 

39. Which of the following can TO be a second-order consumer? 

(l) a strictly herbivarous animal (2) a human (3) a venus flytrap 
(U) a shark (^) a hawk 



UO. Which of the following could be a fourth-order consumer? 

(l) a mouse (2) a plant ^3) a cow (U) a shark ($) a rabbit 



ia. 



If you have ham and eggs and toast and butter and coffee for breakfast, 
you are acting as 



(l) a first order consumer, only (2) a second-order consumer, only 
(3) a first- and a second- and a third-order co^ iumer 

(U) only a second and third-order consumer Lj a third-order consumer only 



U2. Which of the following pairs of food chains may be directly interrelated 
to form a food web? 

(1) grass to mouse to hawk AND algae to fish 

(2) algae to fish to man AND berries to bears 

(3) fish to penguin AND grass to cows 

(U) grass to mouse to eagle AND plankton to whales 
(i) trees to giraffes to lions AND plankton to whales 
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1. In science teaching, analogies are valuable to 

1. Help explain difficult concepts. 

2. Make our work with brighter pupils more challenging. 

3. Introduce mathematics into science teaching. 

4. Add spice to science teaching that is too often dull. 

5. Prove points that may not be acceptable to everyone. 

2. Several students in your class rush up to you and say, ’What would happen if 

you heated a Walloon filled with air OTer a hot plate? Let's try it I tne 

standpoint of good science instruction, your best procedure probably would be to 

1. Encourage them to try it immediately before their enthusiasm is cooled. 

2. First encourage and lead them to use what they know about the relationships 
between gases and temperature to think through what might happen and then 

try it. 

3. Suggest that it would be better to heat the balloon over a candle. 

4. Suggest that they try it at home. 

5. I'ell them not to do 5.t because the balloon would break. 



3. Which of the following food groups is an especially good source of body 
building proteins? 

1. Vegetable and fruit group. 

e 

2. Cereals group'. 

3. Milk group. 

4. Meat and egg group. 

5. None of these. 

4. In scientific investigation the major function of the hypothesis is 

1. To make certain that we consider all data. 

2. To open our minds to the many possible solutions to problems. 

3. To insure that the scientific method is used. 

4. To make it necessary to carry out controlled experiments. 

5. To serve as a tool for directing investigation and inquiry. 
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5. The north pole of an electromagnet may be reversed to south by 

1. Moving it closer to the earth’s south pole. 

2. Unwinding some of the coil. 

3. Reversing the direction of flow of the electric current. 

4 . Removing the core and reversing it. 

5. Passing south-seeking electrons through the coil. 

6. There are two high tides every day at seaports. One high tide occurs when 
the port is on the side of the earth facing the moon. The second high tide 
occurs when the port is on the side of the earth 

1. Opposite the moon 

2. Opposite the sun. 

3. That has the most water. 

4 . Not directly in line with the moon. 

5. Facing the sim. 

7. To hear oncoming horses, Indians sometimes put an ear to the ground. Then 
they were able to hear the horses because 

1. Sound will travel better through soil than air because soil is more dense. 

2. Sound will travel better through soil than air because soil is less dense. 

3. Sound in soil travels more slowly because it is a transverse wave. 

4 . The ground would block out extraneous noises. 

5. Actually they could not hear better by putting their ear to the ground. 

8. Which of the following is an important factor in the process of evolution? 

1. Mutations. 

2. The great variations in climate that have occurred over the long span of 
geological time. 

3. The slow cooling of the earth over geologic time, 

4 . Learning on the part of organisms. 

5. The life force in living protoplasm. 
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9« Most scientists now believe that the earth was formed 

1* As a result of a collision between the sun and another star. 

2. From the same dust cloud as the sun and the other planets. 

3* From a double star of the sun that exploded. 

4. At the same time that all of the rest of the universe was formed. 

5. When a star passed near the sun and some of the solar material that later 
became the planets was torn loose by the tidal forces. 

10. If you want material for potting some plants in your classroom, where would 
it be best to take the children to dig for seme? 

1. The clay bank of the school pond. 

2. The dirt and gravel along the school driveway. 

3. The sandbox. 

4. The bare dirt on the baseball diamond. 

5. The floor of the woods behind the school. 

11. In general, the communicable diseases that plague mankind are transmitted from 

1. Insects to human beings. 

2. Animals to human beings. 

3. Human beings to animals. 

4. Human beings to human beings. 

5. Plants to human beings. 

12. You wish to have your students see what human epithelial cells look like under 
the microscope. One way to obtain samples of these cells is to 

1. Use human tears. 

2. Use a small p?,ece of a fingernail. 

3. Place a drop of blood on a slide. 

4. Gently cut off a piece of skin from the back of your hand. 

5. Scrape the inside of your mouth with a spoon. 
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13. In using a light and a globe to demonstrate the seasons, the students view 
the earth as if they were 

1, Outside the 14ilky Way Galaxy. 

2, At a point in space outside the earth’s orbit. 

3, On the earth. 

4, On or near the moon. 

5, At one of the poles. 

14. The carbon in the bodies of animals comes primarily from the 

1. Soil in their environment. 

2. Air they breathe. 

3. Water they bathe in. 

4. Pood they eat. 

5. Water they dririk. 



15. Water has a number of unique and useful characteristics. One of the best 
ways to help students understand this is to 

1. Break down water into its component parts. 

2. Compare fresh water and sea water. 

3. Set up a terrarium. 

4. Have them read a mimeographed sheet on water and water resources. 

5. Experiment to compare water with another c ramon liquid such as kerosene. 



l6. After a careful demonstration of the phases of the moon using a light and a 
sphere, one of jraur students asks, "In what part of the sky md at wtot tune of 
the night can I best see the thin sliver of the new moon? Your reply should be 



1. "In the west just after sundown." 

2. "I think you can figure that out for yourself." 

3. "There are many books and references about the moon in the library. Why 
don't you see if you can find the answer in one of those when we go to 

the library?" 

4. "Why don't we try part of the demonstration again and see if we can figure 
out the answer to your question?" 

5. Any one of the four above or even some other, depending on your objectives, 
who asked the question, how much time you have, etc. 
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21. On the ohaective lens of the microscope there is printed "lOX" and on the 
eyepiece there is printed "lOX.” This means that the material on a slide will 

be magnified 

1. 0 times. 

2. 10 times. 

3 . 20 times . 

4. 100 times. 

5. 1,000 times. 



22. In using a light and a glob® to demonstrate the seasons, it is important to 



1. Change the intensity of the light to indicate the seasons. 



2 . 



Move the globe nearer to the light in the part of the orbit representing 
summer and farther away in the part of the orbit representing win er. 



3. Change the position of the light during the demonstration. 

4. Carry the globe around the light in as nearly a perfect circle as 
possible. 

5. Keep the globe tilted so that the north pole of the globe is always 
pointing in the same direction. 



23. The sound waves of middle "C" made by chhnes and by a trumpet would 

1. Sound the same. 

2. Have waves of different vibrational frequencies. 

3. Have different wave lengths. 

4. Have the same wave lengths. 

5. Have waves an octave apart. 



24. One of the ways of preventing the spread of malaria is to spread a thin 
film of oil over the water in marshes and ponds. This serves to 

1. Kill the malaria virus in the blood of the mosquito. 

2. Kill the adult mosquito. 

3. Kill the mosquito larva. 

4. Prevent the adult mosquito from laying its eggs. 

5. Prevent the drinking water from becoming contaminated with dust. 
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25* There is an intricate balance between many factors in the environment. 
Therefore, man should 

1, Usually alter a variety of elements in the environment at the same time, 

2, Not be too concerned about his actions because a bal,ance will always be 
maintained, 

3<» Not kill any plants or animals because this upsets the balance, 

4, Never upset the natural balance because by upsetting it he may destroy 
the natural resources he needs, 

5, Try to use what he knows so that when he alters the environment unde- 
sirable effects will not take place. 

26, The following is a diagram of a wave. One wave length would be represented 
by the letter 




3. C 

4. D 

5. E 

27* Which of the following is NOT usually used as a basis for modern weather 
forecasting? 

1, Pressure and temperature tendencies* 

2, Upper air vorticities, 

3, Radioactivity reports, 

4, Maps of upper air winds, 

5, Carefully drawn maps of ground condition reports from many different 
stations. 
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28, You wish to use a dry cell and flashlight hulhs and sockets to demonstrate 
a circuit in which one bulb can bum out but the others will continue to give 
off light. Which of the following circuits would you set up? 




29, A student brings a magnet to school and asks> "Which is the north pole of the 
magnet?" One way he could find out would be to 

1 , See which end of the magnet has an N painted on it. 

2 , See which end of the magnet attracts iron filings. 

3, Bring the magnet next to a compass needle, and the end of the magnet 
that repels the end of the compass needle that points north will be the 
north pole, 

4 , Bring the magnet next to a compass needle, and the end of the magnet that 
repels the end of the compass needle that points south will be the north 
pole, 

5, Hang it from one end with a piece of tape and the north pole of the 
magnet will point south. 



30, The moon ir its orbit around the earth 

1 , Shines on the earth with special brilliance when it is between the sun 
and the earth, 

2 , Moves along with the earth in an orbit around the sun. 

3, Eclipses the earth once every 29J days. 

4, Boes not revolve, 

5, Radiates light more brilliantly during some periods of the month than 
others . 
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31* You have your students stare at a piece of red paper for two or three minutes* 
When you remove the red paper they see green* You es^lain tills phenomenon by 
saying 

1* The receptors for red light in the retina tired wlrLle those for green 
did not* Therefore, the tired eyes would he more receptive to the 
green part of the spectrum. 

2. The receptors for red light in the retina become stronger* Therefore, 
they tended to see the green part of the spectrum. 

3* The white screen behind the red paper had changed to green because of 
the light shining through the red paper* 

4. It really doesn’t happen* 

5* It was an optical illusion* Behind the red paper there was some green 
paper* 

32* In scientific terms heat differs from temperature in that heat is 
1. Measured with a theimcmeter* 

2* A measure of the average kinetic energy of the molecules* 

3* Not transmitted by conduction* 

4* A measure of the total kinetic energy of a system* 

5* Measured in degrees rather than calories* 

33* A nujnber of students in your school contract dysentery* It is possible this 
happened because 

1. They were bitten by anopheles mosq.uitos* 

2* They contracted it frcm a pet bird in the room* 

3. They breathed in small droplets sprayed into the air when another person 
who had dysentery sneezed* 

4. The food in the cafeteria was contaminated with bacteria carried by flies* 
5* They were inoculated with unclean inoculation needles* 

34* Scientists now believe that the earth is several 
1. Thousand years old. 

2* Hundred thousand years old* 

3* Million years old. 

4* Hundred million years old* 

Billion years old* 



5* 
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35* It is suspected that a magnet has more than two poles. One way to find out 
would he to 

1. Pull the magnet between the poles of a strong alnico magnet. 

2. Sprinkle iron filings onto a piece of paper placed over the magnet and 
study the magnet lines of force. 

3. Cut the magnet in two to see whether or not each of the resulting pieces 
has two magnetic poles. 

4. Examine the magBtac domains with a magnifying glass to see whether they 
are lined up. 

5. Tape a string to the center of the magnet and see whether or not it lines 
up in a north- south direction. 

36. On March 21 (the vernal equinox) at noon the sun would be seen as directly 
overhead from a position on the 

1. Arctic circle (66° 30’ N. Latitude). 

2. Tropic of Cancer (23° 30' N. Latitude). 

3. Equator. 

4. Tropic of Capricorn (23° 30' S. Latitude). 

5. Antarctic circle (66 30* S. Latitude). 

37. In using a light and a sphere to demonstrate the phases of the moon, the 
students who see the phases see them as if they were located 

1. At a point in space on the earth’s orbit, but opposite the earth. 

2. On or near the earth. 

3. At one of the poles. 

4. On or near the sun. 

5. On or near the moon. 

38 > A key operation in measurement is 

1, Using the same kind of measuring instrument that everyone else uses. 

2. Using the metric system whenever possible. 

3e Comparing the property being measured with some standard. 

4. Using a measuring instrument with internationally accepted units. 

5, Using the same measuring instrument whenever possible. 
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39- satellite in orbit is always 

1. Traveling in the same direction. 

2. Traveling in a perfect circle aroimd the body it is orbiting. 

3. Maintaining velocities greater than escape velocity. 

4. Being accelerated "by a rocket engine. 

5. Palling aronud the body it is orbiting. 

40. Which of the fo3JLowing analogies is often used to explain how a satellite 
stays in orbit: 

1. Galaxies marked on an expanding rubber balloon. 

2. A cannonball shot from a mountaintop so that it will fall around the 
earth. 

3. If A=B and C*=B, then C=A. 

4. A magnetic field as compared to an electric field. 

5. The relationship of a small country to a big one. 

41. What happens when a gas is heated? 

1. The gas molecules are compressed. 

2. The molecules of the gas all tend to move in the same direction. 

3. New molecules of gas are generated. 

4. The average velocity or speed of the gas molecules is increased. 

/ 

5. The gas as a whole is heated but the individual molecules of the gas 
are unaffected. 

42. Food is utilized in the body in somewhat the same way as fuel is oxidized 

in the burning of a candle. However, the body is able to obtain energy from foods 
at temperatures lower than those in a candle flame because 

1. The food in the body is not really oxidized. 

2. !Da the body there is reduction of fuel rather than oxidation. 

3. There is a sudden, short rise in temperature at the moment of oxidation. 

4. The actual temperatures in the cells are of the same order as those in 
a candle flame. 

5. Enzymes act as catalysts in the oxidation of the food. 
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43. In solving a science problem we have to 
centimeters wide and 60,55 centimeters long, 
this surface is 

1. 2429.2660 square centimeters. 

2. 2429.27 square centimeters. 

3. 100.67 square centimeters. 

4. 100.67 cubic centimeters. 

5 . 2429 square centimeters. 

44. Which of the following is MOT one of the properties of water? 

1. It is a solvent. 

2. It is odorless. 

3. It rusts iron and other metals. 

4. It is colorless. 

5 . It contracts when it freezes. 

45. If a chime bar were made shorter it would probably 

1. Lose its chime-lihe tone. 

2. Produce longer sound waves. 

3. Make no musical sound. 

4. Have a lower frequency sound. 

5 . Have a higher frequency sound. 

46. An interesting pro^ject in elementary school science is growing crystals. 
However, one of your students found that his seed crystal dissolved when he put 
it into the solution. Probably, the seed crystal dissolved because the 

1. Solution was super- sat\irated. 

2. Solution was too cold. 

3. Seed crystal was too warm. 

4. Seed crystal was too cold. 

5 . Solution was too dilute. 

er|c 



find the area of a surface that is 40.12 
The correct statement of the area of 

f 
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4 ?. Which of the following is NOT a simple machine? 

1. A shovel. 

2. A steering wheel. 

3. A file drawer. 

4. A block and. tackle. 

5. A nut cracker. 

1»8. m helping students to make a siBiple electric motor it is important to 

1. Have one brush make contact with one end of the armature wire while the 
other brush makes contact with a permanent magnet. 

2. Wind the wire in the armature coil always in the same direction. 

3. Keep the ends of the armature wires insulated. 

4. Connect the ends of the armature wire together. 

5. Have the ends of the field magnets nearest the rotating armature either 
both south poles or both north poles. 

49, Which of the following is a major difference between sound waves and light 
waves? 

1. Sound waves transmit energy while light waves do not. 

2. Sound waves travel faster than light waves. 

3. Light waves will travel through transparent materials while sound waves 
will not. 

4. Light waves require a medium for transmission while sound waves do not. 

5. Sound waves vibrate in the same direction as the wave travels while the 
light waves vibrate at right angles. 

50. Almost all of the energy we use on earth comes either directly or indirectly 
from two sources. These are the 

1. Earth and the moon. 

2. Sun and the moon. 

3. Sun and other stars. 

4 . Earth and nuclear reactions on earth. 

5. S\ui and nuclear reactions on earth. 
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51. You TrTish to have your students see the size of the pupils of their eyes 
become smaller. You divide your class into groups of two and ask them to look 
into their partner’s eyes and then 



1. 


Turn the lights on bright for a short time and then turn them off. 


2. 


Have each of them blink as fast as they can. 


3. 


Stare into each others pupils as hard as they can. 


4. 


Turn the lights off for a short time and then turn them on as bright as 
possible. 


5. 


Focus their eyes on some distant object. 



52. A device designed specifically to intensify or increase electric current is 



1. 


A radar set. 


2. 


A resistor. 


3. 


A diode. 


4. 


An amplifier. 


5. 


An oscilloscope. 



53* Energy has been defined as 



1. 


The amount of difficulty encountered in attempting to move an object. 


2. 


The ability to do work. 


3. 


The strength of an object. 


4. 


A force acting through a distance. 


5. 


The total velocity of the molecules in an object. 



54. In viewing an eclipse of the moon (a lunar eclipse), the teacher should suggest 
that students 



1. 


Note the curved edge of the shadow of the earth. 


2. 


Hold smoked glass or photographic negatives in front of their eyes. 


3. 


Note the craters on the moon. 


4. 


Note the corona which is only visible during a lunar eclipse. 


5. 


Note the shadows of the mountains and high buildings on the earth. 
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55 • An airplane can stay aloft because 

1. The propellers or jets are pulling the plane up and forward faster than 
it can fall. 

2. All objects in a fluid, such as air, are lifted by a force equal to the 
weight of the fluid displaced by the object and this force is enough to 
keep the plane aloft-, 

3. The propellers or jets are tilted slightly so that they push down and the 
plane stays up as an equal and opposite reaction according to Newton’s 

third law. 

4. The air flows faster over the curved upper surface of the wing ^d so 
exerts less pressure down than is exerted up by the slower flowing air 

underneath. 

5 . There is a vacuum created above the wing and this means the pressure up 
on the wing is greater than the pressure down on the wing. 

56 . You wish to demonstrate how sound waves travel. One of the best ways to do 
this is to use a 

1 . Sound meter. 

i 

2. Coiled spring such as a "slinky." 

3 . Dangling rope. 

4. Megaphone. 

5 . Telephone. 



57 . Jack said, "Sound travels in waves. Here is what these waves are like. ^ich 
of the following characteristics of sound waves that Jack stated is NOT correct? 



1 . Sound waves travel slower than light waves. 

2. Sound waves are like waves on the surface of water. 

3 . Sound waves are compressional waves. 

4. Sound waves will travel through metals and water as well as through air 

5 . Sound waves will not travel through a vacuum. 



58 . Which of the following lists places these four components of most higher 
living organisms in order of complexity froB least to most ccMplex? 

1. Tissues, cells, organs, systems. 

2. Cells, tissues, systems, organs. 

3 . Systems, organs, tissues, cells. 

4. Cells, organs, systems, tissues. 

5 . Cells, tissues, organs, systems. 



o 
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59. In a controlled experiment 

1. It is desirable that none of the factors be varied. 

2. Several factors are varied to study the effect of changing all of them. 

3. All factors are controlled but one, so that the effect of changing one 
factor can be studied. 

4. A different type of observation shovad be used for each of the variables 
being studied. 

5. Time cannot be one of the variables. 

60. Di which of the following does man NOT malce direct use of living or once 
living material? 

1. Irrigation. 

2. Heating. 

3. Eating. 

4. Clothing. 

5. Book printing. 

61. A student has measured the height to which a ball bounces on successive 
bounces and obtained the following data: 



1st bounce 
2nd bounce 
3rd bounce 
4th bounce 
5tb. "bcnmee 



100 centimeters 
81 centimeters 
60 centimeters 
39 centimeters 
17 centimeters 



In graphing his data whinh -bH© ©oovdinat© «yot«=‘ias should he use: 



100 - ‘ 

80- 
60- 
4o- 
20 • 

0 ) 1 » > H 



012345 

200r 



150 » 

100 * 

50- 

C- 



/ 




t- 




12345 



12345 
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62. Which of the following is NOT a method for controlling the spread of disease 
through a community? 

1 . Homogenizing milk. 

2. Inspecting restaurants. 

3. Processing sewage. 

4. Vaccinating children. 

5. Sterilizing bottling equipment. 

63 . On a field trip you discover a seam of igneous rock between two layers of the 
same fossiliferous rock. The most probable explanation for the location of the 

igneous rock is 

1. The three layers were laid down simultaneously. 

2. The three layers were laid down simultaneously, but what is now igneous 
was then something else and due to differential heating became changed. 

3 . The three layers were laid down sequentially from bottom to top and under 
terrific heat and pressure changed into what you see today. 

4. The three layers were laid down sequentially from bottom to top. 

5 . The Igneous materials intruded into the fossiliferous rock while it was 
still fluid enough to flow. 

64. One of the features that differentiates an animal from a plant is that 

1 . Animal cells have a nucleus while plant cells do not. 

2. Animals move but plants do not. 

3* Animals are sensitive to stimuli while plants are not. 

4. Animal cells do not have a cell wall while plant cells do. 

5 . Animals reproduce sexually while plants can not. 

65 . The pressure of the outside air can be made to crush a metal can. One way 
to demonstrate this is to 

1. Fill the can with water. i\llow the water to run out of the can through 
a long piece of rubber tubing. 

2. Take the can to high altitudes in an \mpressurized airplane. 

3 . Fill the can with air and then take it down into the deepest hole you 
can find where the air pressure is greater. 

4. Put the can under a bell jar and pump the air out. 

5 . Put a little water in the can. Tightly cap the can. Place it on a hot 
plate and boil it as furiously as possible. 
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66. An -Important concept in ecology is that of the ’‘climax" condition. By 
"climax" condition "we mean 

1. A condition of collapse as a result of the imbalance of population. 

2. The condition brought about by intensive agriculture. 

3. The condition that leads to radical change in the plant and animal 
population of an area. 

4. The condition of greatest activity in the plant and animal community. 

5. A condition that will exist indefinitely if no major changes take place 
in the environment. 

67 . On a field trip you and your students find, near the top of a hill, fossils 
of organisms that must have lived in the oceans. The probable explanation for 
this is 

1. The fossils were transported to the hilltop by some geologic agent. 

2. The entire earth must have been under the ocean. 

3 . The organisms must have been capable of traveling from the oceans to this 
hilltop. 

4. At one time these organisms must have been capable of living on land. 

5 . The rocks near the top of the hill must once have been under water. 

68. Elementary school students can make a simple fire extinguisher from 

1. Loaon juice and aluminum. 

2. Ammonium chloride solution and a nickel. 

3 . Vinegar and baking soda. 

4. Zinc and sulfuric acid. 

5 . Any weak acid and any weak base. 

69 . For species of plants and animals to survive it is important that they 

1. Have adaptations that will allow some individuals to survive until they 
can reproduce. 

2. Have as wide a range of adaptations as possible. 

3 . Reproduce sexually. 

4. Have a long life span. 

5 . Be adapted to live in a wide variety of environments. 
o 

ERIC 
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70, The atmosphere that surrounds the earth consists mainly of 

1. Nitrogen and oxygen and carbon dioxide. 

2. Oxygen and hydrogen. 

3. Carbon and hydrogen. 

4 . Nitrogen and hydrogen. 

5. Oxygen and carbon dioxide and water vapor. 

71, A BunSen burner is busaiing with a very yellow flame. To get a hot blue flame 
it will be necesssiry to 

1. Clean out the burner. 

2. Allow more air to enter the burner. 

3. Shut off the burner and relight it. 

4 . Change the tip on the burner. 

5. Allow more fuel to enter the burner. 

72* Some of your students wish to make an insect collection. The chemical often 
used as a killing agent is 

1. Camphor. 

2. Cyanic acid. 

3* Carbon tetrachloride. 

4 . Chlorine. 

5. Plaster of paris. 

73* The spectrum of light from certain distant galaxies is shifted toward the 
red end of the spectrum because 

1. This light travels faster than ordinary light. 

2. As light travels over great distances it tends to become redder. 

3. These distant galaxies are probably younger than ours. 

4 . These distant galaxies are moving away from us at tremendous speeds. 

5. This light was redder in the first place. 



1 
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?4. You wish to obtain a supply of microbes for your pupils to examine under the 
microscope. The following is a common way of obtaining microbes for study. 

1 . Obtain a sample of river water near a point where a sewer empties into 
the river. 

2. Take a sample of tap water. 

3 . Place some hay in wate:: and allow it to stand for a couple of weeks. 

4. Allow some water to stand in warm sunlight for several days. 

5. First contaminate some agar plates and then place a penicillin disk on 
the agar plate. 

75. Of the following, which is NOT necessary for a fire to continue burning? 

1. Ample fuel. 

2. Ample supply of carbon dioxide. 

3. Tengperature above kindling temperature. 

4. Contact between or mixing of fuel and oxygen. • 

5 . Ample supply of oxygen. 

76 . Which of the follox-zing has the LEAST influence in shaping and reshaping the 
earth *s surface? 

1 . Weather. 

2. Glaciation. 

3 . Meteor showers. 

4. Vulcanism. 

5 . Pressure within the earth. 

77 . nil what stage of the water cycle do we make the most use of water? 

1. While it is in the atmosphere. 

2. After it falls as rain and before it reaches the ocean. 

3 . We make about the same amount of use of it in each of the stages of the 
cycle . 

4. After it leaves the oceans and before it falls as rain. 

5 . After it reaches the ocean and before it reaches the atmosphere. 
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78, In most classification systems objects are classified on the basis of certain 
properties. To be useful the classification system should be based on types of 
properties that 

1, Vary with time. 

2, Are possessed by relatively few of the objects to be classified, 

3* Are possessed by l of the objects to be classified, 

4, Can only be detected by people who are familiar with the classification 
system, 

5, Have been accepted by scientific organizations as bases for classification. 



79, How does lime that is spread on soil often improve plant growth? 

1, It kills certain harmful fungi. 

2, It provides calcium for the plants, 

3, It kills certain harmful bacteria, 

4, It neutralizes basic soil, 

5, It neutralizes acidic soil. 



80, 

One 



You want to demonstrate to your students how to make a simple electric cell, 
of the best and safest ways of doing this is by using the following materials 



1, Zinc, sulfuric acid and plastic. 

2* Ammonium chloride solution and two carbon rods. 

3. Zinc, ammonium chloride solution and a carbon rod. 

4, Sulfuric acid and two pieces of lead. 

g , r hTnrifi a 



8l« The angle between an incident beam light and a plane mirror is 35 * The 
angle between the mirror and the reflected beam of light would be 

1. 55° 

2. 35°„ 

3. 325° 

U. 305 

5. linpossible to predict. 
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82. Which of the following would be a practical way of demonstrating the presence 
of a very small electric current in a wire 2 

1. Careflilly, but quickly, touch the wire to see if you get a small electric 
shock. 

2. Wind the wire around a nail and see if the nail will attract a paper clip. 

3. Scratch the two ends of the wire together to see if you get a spark. 

4. Connect the ends of the wire to a watt-hour meter. 

5. Wind the id.re around a compass. If there is a current in the wire, the 
compass needle will line up at right angles to the coil of wire. 



83 . Which of the following is an important generalization concerning machines? 

1. With all machines, lubricants are necessary for effective operation. 

2. All machines would operate if we could completely eliminate friction. 

3 . Becatise of friction we always have to put more work into a machine than 
we get out of it. 

4. The major advantage of a machine is that we can get more work out of it 
than we put into it. 

5 . The output force is always less than the input force. 



84. Cue of your students has strong religious beliefs and feels that the discus- 
sion of such hypotheses concerning the origins of the inverse as the stea^ 
state hypothesis" and the ’’big bang hypothesis" are inimical to her b^ief that 
God created the universe . As a teacher what response should you make ■ 

1. Point out to the student the much stronger evidence that can be m^shaled 
to support scientific hypotheses concerning the origins of the universe. 

2. Alter the remainder of the work in science so that material that might 
be questioned by people of various religions would not be included. 

3 . It is best to ignore the religious beliefs of students. 

4. Suggest that the student should become aware of the various views ^d 
approaches to the explaining of the origins of the universe including 
both the religious and the scientific approaches to explanation. 

5. Discuss with the student the pertinent sections of religious books ^d 
try to show how these sections are consistent with scientific hypotheses. 
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The purpose of this study f..3 to measure the meanings of certain thJ. i^s 
to various people by having them judge those things against a series c E 
descriptive scales o In taking this tost, please make your judgments on 
the basis of uhat the things moan to you-> On each page of this bookie* • 
you will find a different csoncopt to be judged and beneath it a sot of 
scales o You are to rate the concept on each of the scales in order » 



Hers is hew ;;,ou are to use these scales: If you feel that the con--- 

copt at the top of the page is very closely related to one end of the 
scale; you should pla^e yoir* crass-’mark as follows; 



lair X 



unfair OR fair 



: X unfaJ-'r 



If you feel that the concept is quite closely related to one or the other 
end of the scale (but net oztreiaely ) , you should place your cross^-^arlb 
as follows : 



fair 



X 



unfau 



r OR fair 



X 



I'nfa; r 



If the concept seems only slightly related to one side as opposed tj *clo 
other side (but is not rcal?.y neutral), then you should check as fellas z 



fair 




unfair OR fair 




unfair 



The direction toward yjliich you check;, of course,, depends on which of *bhe 
two ends of the scale seem most characteristic of the. thing you*rure j;udgingo 
If you consider the coiicept to be neutral on the scale, both siders of 
the scale equally associated with the concept, or- if the scale is complete'--* 
ly irrelevant; unrelated bo the concept, then you should place yo.rcf cross'- 
mark in the middle space; 

fair : : X ; : : unfair 



IMPORTANT ; 

1© Place your cross-Hnarks In the middle of spaces, not on the boundriess 

^ 3-ir ; ; ; ; ; X unfair 

TKI8 ■ NOT THIS 



2o 3e sure you checii. every scale for every concept do not on:.t 

3* Never put mere than one mark on a singl-, scale <> 

U* Do not look back and foith through the items, but try to make each 
item a separate and independent judgment. 

Work at fairly high speeds <> Do not worry over items, but instead 
check your first impression, your immediate "feelings” about the 
item. On the other hand., don’t be careless, because we are Intoir-- 
ested in your tru^ inprersionso 





^^MfSELF AS A SCIENCE TEACHER 
SCIENTIFIC INVESTIGATIONS BY PUPILS 
MY ELEMENTARY SCHOOL 
PROCESS-CENTERED ACTmTIES 

indivi:dualized science activities 

DISADVANTAGED CHILDREN 
"DIFFICULT" STUDENTS 
MY TEACHING SKILLS AND TECHNIQUES 
SCIENCE INSTRUMENTS AND MATERIALS 
SCIENTIFIC KNOWLEDGE 


valuable 


. : ; ; ; : . .worthless 


simple 


; : : : ; : complicated 


unpleasant 


•;:!!: pleasant 


familiar 


; : ; ! ; : strange 

mmimmmmm m trnrnmmmmm 


dull 


; ; : : : : interesting 



unpredictable : t : ? s s predictable 



important 


: ; ; ; ; : unimportant 


mysterious 


; • : ; : ! understandable 


hard 


; ! ; ; ; ; easy 


chaotic 


• ; ; : ; t ordered 



* Note ; For the copy used in the testing sessions, each concept 
occupied a separate page. The order of the pages was 
randoffiiised, but the scale sets were in the same order 
for each concept. 



NDEA INSTITUTE IN SCIENCE 

TEACHEH»PA:IT1GIPANT evaluation of the effectiveness of the INSTITUTE 



Below is a listing uf some of the objectives of the NDEA Institute, including some 
of the methods and j roucdci’.^c cv.ipiiasized in reaching these goals. Please rate each 
of these statements in terms of the degree of effectiveness you think the Institute 
has had with you in meeting these objectives. Blacken the space on the answer 
sheet that corresponds to the number (l 2 3 ) which best describes, in your 

opinion, how effective the Institute has been: 



1 The Institute has had a NEGATIVE EFFECT on 

2 The Institute has had NO EFFECT on 

3 The Institute has had SOME POSITIVE EFFECT on 

h The Institute has had OUTSTANDING POSITIVE EFFECT on 



Please be sure to rate each of the goals. Each goal is preceded by a question 
number. ^ In filling in the answer sheet, be careful to indicate your choice in the 
appropriate blank space. You may erase, but be sure to do so completely. 

1. Your knowledge of the growth of animals and plants. 

2. Your knowledge of heat and its effects upon the phases of matter. 

3. Your knowledge of motion and its relation to frames of reference. 

Your knowledge of the adaptive responses of plants and animals. 

5. Your knowledge of temperature and thermometers. 

6. Your knowledge of the earth and its relation to the sun. 

7. Your familiarity with available science materials, methods, procedures and 

sources of information. 

8. Your ability to distinguish among a variety of teaching approaches, e.g., 

field experiences, demonstrations, experiments, etc. 

9. Your abiHty to evaluate teaching experiences to determine how well it will 

demonstrate a specific science concept. 

10. Your ability to select the appropriate teaching experience through which 

pupils may achieve specific science concepts. 

11. Your ability to exploit extant materials for presenting concepts to pupils. 

12. Your ability to use home and community experiences to develop science concepts. 

13. Your ability to scan science trade books for appropriate and pertinent concepts, 

la. Your ability to examine trade books for the purpose of abstracting the content. 
Ip. Your ability to write explanations of science concepts. 

l6. Your ability to coordinate the use of textual and laboratory materials. 

17* Your ability to plan simple experiences to teach science concepts to pupils. 

18. Your skill in designing, constructing and/or assembling simple materials. 

19. Your skill in using models to study and explain science phenomena. 

20. Your skill in using science instruments and materials. 

Your ability to direct and focus attention on the problem being considered. 

22. Your ability in making the topic or aim of the lesson clear to the pupils. 

23 Your ability to plan and organize individual and/or small group observation 

of a natural phenom.enon. 

Your skill in leading individual and/or small group observations and discussions 
of a natural phenomenon. 

2$, Your abiliuy to increase the opportunities for pupils to collect data and make 
observations. 

26. Your skill in raising pertinent questions about the findings. 

27. Your ability to encourage pertinent questions about the findings from pupils. 

20. Your ability to exploit and expand pupils* findings, examples and inquiries. 

29. Your ability to collect, organize and interpret simple science data. 

30. Your skill in leading and conducting discussions of the findings. 

31 • Your ability to conduct summarizations that answer the original questions. 

32. Your ability to conduct summarizations that raise new, but related, questions. 

33. Your skill in evaluating the extent to which pupils have mastered a concept. 

3a. Your enjoyment of science. 

Your ease and confidence with materials and ideas in teaching science to pupils. 
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Imagine another group of teachers similar bo yourself# All things considered^ 
would you be in favor of this Institute being continued, discontinued, or modified 
for them? Please check one of the alternativegand explain the reasons for your 
decision: 

Continued! 



Discontinued: 



Modified: 



Please list below the specific areas, problems or objectives that you personally 
received most help in, least help in: 

Most Help In: 



Least Help In: 



Certainly no program is perfect. We would welcome any suggestions for the 
improvement of this type of Institute program. Please try to be as specific as 
possible in describing the strengths and weaknesses of your summer Institute 
experiences. 



If you wish, please sign your name 



NDEA INSTITUTE IN SCIENCE 

SUPERVISOR-PARTICIPANT EVALUATION OF THE EFFECTIVENESS OF THE INSTITUTE 



Below is a listing of some of the objectives of the NDEA Institute, in- 
cluding some of the methods and procedures emphasized in reaching these 
goals. Please rate each of the following statements in terms of the 
degree of effectiveness you think the Institute has had in meeting 
these objectives with the teacher -participants in your group. Circle 
a number (l 2 3 U ) which best describes your "general opinion of how 
effective the Institute has been: 

1 The Institute has had a NEGATIVE EFFECT on 

2 The Institute has had NO EFFECT On 

3 Ihe Institute has had SOME POSITIVE EFFECT on 

U The Institute has had OUTSTANDING POSITIVE EFFECT on 

1 2 3 U Teachers* knowledge of the growth of animals and plants. 

1 2 3 I 4 Teachers* knowledge of heat and its effects upon the phases of 
matter. 

1 2 3 I 4 Teachers* knowledge of motion and its relation to frames of 
reference . 

1 2 3 I 4 . Teachers* knowledge of the adaptive responses of plants and 
animals • 

1 2 3 U Teachers* knowledge of temperature and thermometers. 

1 2 3 U Teachers’ knowledge of the earth and its relation to the sun* 

1 2 3 U Teachers’ familiarity with available sciende materials, methods, 
procedures and sources of information* 

1 2 3 h Teachers’ ability to distinguish among a variety of teaching 

approaches, e*g., field experiences* demonstrations, experiments, etc. 
1 2 3 h Teachers* ability to evaluate teaching experiences to determine 
how well it will demonstrate a specific science concept. 

1 2 3 U Teachers’ ability to select the appropriate teaching experience 
through which pupils may achieve specific science concepts, 

1 2 3 U Teachefs’ ability to exploit extant materials for presenting 
concepts to pupils. 

1 2 3 h Teachers’ ability to use home and community experiences to 
develop science concepts. 

1 2 3 U Teachers* ability to scan science trade books for appropriate 
and pertinent concepts. 

1 2 3 h Teachers* ability to examine trade books for the purpose of 
abstracting the content. 

1 2 3 U Teachers’ ability to write explanations of science concepts. 

1 2 3 U Teachers* ability to coordinate the use of textual & laboratory 

materials. 

1'2 3 U Teachers’ ability to plan simple experiences to teach science 
concepts to pupils. 

1 2 3 U Teachers’ skill in designing, constructing and/or assembling 
simple materials. 

1 2 3 U Teachers’ skill in using models to study & explain science 
phenomena. 

1 2 3 U Teachers* skill in using science instruments and materials.^ 

1 2 3 U Teachers’ ability to direct & focus attention on problem being 

considered. 

1 2 3 U Teachers* ability in making the topic or aim of the lesson clear 
to the pupils. 

1 2 3 U Teachers’ ability to plan & organize individual and/or small 
group observation of a natural phenomenon. 

1 2 3 U Teachers’ skill in leading individual and/or small group 
observations & discussions of a natural. phenomenon. 
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1 2 3 U 

1 2 3 U 
1 2 3 U 

1 2 3 U 

1 2 3 U 

1 2 3 U 
1 2 3 U 

1 2 3 U 

1 2 3 U 

1 2 3 U 
1 2 3 U 



Teachers’ ability to increase the opportunities for pupils to 
collect data and make observations. 

Teachers' skill in raising pertinent questions about the findings. 
Teachers' ability to encourage pertinent questions about findings 
from pupils. 

Teachers' ability to exploit & expand pupils' findings, examples 
and inquiries. 

Teachers' ability to collect, organize & interpret simple science 
data. 

Teachers' skill in leading k conducting discussions of the findings. 
Teachers' ability to conduct summarizations that answer the orig?.nal 
questions. 

Teachers' ability to conduct summarizations that raise new, but 
related, questions. 

Teachers' skill in evaluating the extent to which pupils have 
mastered a concept. 

Teachers’ enjoyment of science. 

Teachers' ease k confidence with materials k ideas in teaching 
science to pupils. 



All things considered, would you be in favor of this Institute being con- 
tinued, discontinued or modified next year to include another group of 
supervisors and teacher -participants similar to yourselves? Please check 
one of the alternatives and state the reasons for your choice: 



Continued: 



Discontinued: 



Modified: 



Please list and describe below the specific areas, problems and/or objectives 
that you feel the teacher -participants received most help in, least help in: 

Most Help In Least Help In 



In what ways do you think the supervisors were most helpful in, least helpful in; 
Most Helpful In Least Helpful In 



Certainly no program is perfect; we would welcome any suggestions for the 
improvement of this type of Institute program. Please try to be as specific 
as possible in describing the strengths and weaknesses of the summer 
Institute experiences. (Use the back of this page.) 
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